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Abstract 



H 

^ We investigate the two unicast flow problem over layered linear deterministic networks with arbitrary 

, number of nodes. When the minimum cut value between each source-destination pair is constrained to 

^ be 1, it is obvious that the triangular rate region {(i?i, i?2) : Ri,R2 > 0, i?i +i?2 < 1} can be achieved, 

^ and that one cannot achieve beyond the square rate region {(i?i,i?2) : Ri,R2 > 0, i?i < l,i?2 < !}• 
Analogous to the work by Wang and Shroff for wired networks [1], we provide the necessary and 

m 

\Q sufficient conditions for the capacity region to be the triangular region and the necessary and sufficient 

to conditions for it to be the square region. Moreover, we completely characterize the capacity region 

o 

^-H and conclude that there are exactly three more possible capacity regions of this class of networks, in 

• • contrast to the result in wired networks where only the triangular and square rate regions are possible. 
> 

Our achievability scheme is based on linear coding over an extension field with at most four nodes 

X 

^ performing special linear coding operations, namely interference neutralization and zero forcing, while 



all other nodes perform random Unear coding. 



I. Introduction 

Characterizing the fundamental Umit of deUvering information from multiple sources to mul- 
tiple destinations over networks is the holy grail in network information theory. The ultimate 
goal is to characterize the capacity region of multi-source-multi-destination information flows 
over arbitrary networks. Exploring wired network models yields fruitful understanding in this 
problem, and the capacity of single unicast [2] and multicast [3] are fully characterized. In 
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wired networks, however, all links are orthogonal to one another, and such a model cannot 
fully capture the broadcast and superposition nature of wireless networks. In [4], a deterministic 
approach is proposed as a bridge for using results in wired networks to help understand wireless 
network information flow. The proposed linear deterministic network model turns out to be very 
useful for studying wireless networks as it preserves the broadcast and superposition aspects. 
Capacity of several traffic patterns are characterized completely in linear deterministic networks 
and approximately in Gaussian networks, including single unicast and multicast [4]. 

In the above mentioned problems where good understanding has been established, there is only 
one user's information flow in the network and no interference from other users. However, as for 
how multiple information flows interact as they interfere with one another, very little is known. 
To the best of our knowledge, even for the two unicast problem, there is no capacity results 
for general wired networks, let alone the general multi-source-multi-destination information flow 
problem. Instead of attempting directly to characterize the capacity region for the general two 
unicast problem, in [1] Wang and Shroff study the solvability of two-unicast wired networks, 
or equivalently, the achievability of the (1,1) rate pair, for two unicast flows over arbitrary 
wired networks with integer link capacities, to make progress in this problem. They provide the 
necessary and sufficient condition for achieving the (1,1) rate pair. They show that a simple 
sum rate outer bound called the Network Sharing Bound [5] turns out to be tight for the (1, 1) 
point, i.e. if the integer- valued bound is strictly greater than 1, then (1,1) can be achieved. The 
result in [1] can also be understood as characterizing the capacity region for the class of wired 
networks where the minimum cut value between each source-destination pair is constrained to 
be 1. This is because that rate pairs outside the square rate region (5 := {(i?i,-R2) '■ R11R2 > 
0, /?i < 1, /?2 < 1} cannot be achieved, while those in the triangular rate region T := {(-Ri, -R2) '■ 
Ri,R2 > 0, i?i + < 1} can always be achieved by time-sharing and routing. The result in [1] 
implies that once one can achieve beyond the triangular region T, one can achieve the square 
region (3. Hence, there are only two possible capacity regions for this class of networks, the 
triangular region T and the square region &. See Fig. 1 for an illustration of these rate regions. 

In this paper, we take an initial step towards understanding the two unicast flow problem over 
linear deterministic networks [4] with arbitrary number of nodes. Our main result is an analog 
of [1] over linear deterministic networks. We assume that all channel strengths are zero or unity, 
that the network is layered and that each source can reach its own destination, and hence the 
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(a) Network Sharing Bound = 1 (b) Network Sharing Bound > 2 

Fig. 1. Capacity Regions for Wired Networks [1] 

minimum cut value between each source-destination pair is constrained to be 1. Similar to wired 
networks, rate pairs outside the square rate region & cannot be achieved, and rate pairs inside 
the triangular rate region X can be achieved by time-sharing between two users' single unicast 
flows. For this class of networks, we completely characterize the capacity region. We show that 
the capacity region of such a network must be one of the five regions depicted in Fig. 2, and 
provide the necessary and sufficient conditions for the capacity region to be each of them. 

Regarding when one can achieve beyond the trivially achievable T, we provide a novel sum 
rate outer bound on two unicast flows over linear deterministic networks, analogous to the 
Network Sharing Bound. This outer bound is intimately related to the Generalized Network 
Sharing outer bound [6] for wired networks. We show that if this bound does not constrain the 
sum rate to be upper bounded by 1, then indeed one can achieve beyond the triangular rate region 
1, and hence establish the necessary and sufficient condition for the capacity region being 1. 
In contrast however, to achievability of the (1,1) point in [1], we find that we cannot always 
achieve (1,1). Instead, we show that once one can achieve beyond T, one can achieve either one 
of the two trapezoid rate regions: T12 := {(^1, ^2) : ^1, ^2 > 0, it!2 < 1, '2Ri + -R2 < 2} and 
^21 '■— {{Ri: R2) '■ Ri: R2 > 0, it!i < 1, Ri + 2R2 < 2}, and there are networks whose capacity 
regions are X12 or T21. 

Regarding when one can achieve the full square <3, we investigate the achievability of the 

(1, 1) point, and find the necessary and sufficient conditions for it. For single source unicast 
and multicast problems, random linear coding over a large finite field at all nodes suffices to 
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Fig. 2. Capacity Regions for Linear Deterministic Network 



(e) Q\0 



achieve capacity in wired as well as linear deterministic networks [3], [4]. This is no longer 
the case for the two-unicast problem since each destination is interested only in the message 
of its own source. Indeed, we can identify two nodes, one for each destination, that must be 
able to decode the messages of their respective destinations. We call these two nodes critical 
nodes and their receptions are required to be completely free of interference from the other 
user. For this purpose, at certain nodes interference from the other user has to be cancelled 
"over-the-air", which is called interference neutralization in the Uterature [7] [8]. Other than 
the nodes performing interference neutralization, all other nodes may perform random linear 
coding. The parents of each critical node are the natural candidates to perform interference 
neutralization, although they are not the only ones. We introduce a systematic approach to 
capture the effect on the rest of the network caused by interference neutraUzation, and provide 
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the graph-theoretic necessary and sufficient conditions for (1, l)-achievabiUty. Moreover, we 
show that if (1, 1) cannot be achieved, then the capacity region is contained in the pentagon 
region ^ := {{Ri, R2) '■ Ri, R2 > 0, R2 < 1, -Ri + -R2 < 3/2}. Moreover, there are networks 
whose capacity regions are 

Continuing further, we characterize the necessary and sufficient conditions for the capacity 
region to be %i2, X21, and ^ respectively. The outer bounds on 2Ri + R2, Ri + 2i?2 for the 
trapezoids T12, T21 respectively and that on Ri + R2 for the pentagon ^ are inspired from the 
interference channel outer bounds [9]. The scheme we propose is hnear over the extension field 
¥2r for r sufficiently large. Note that unlike single multicast where a random (vector) linear 
scheme over the base field ¥2 suffices to achieve the capacity [4], in the two-unicast problem 
not only does the linear scheme operate on a larger field but also some nodes need to perform 
special linear coding (in contrast to random linear coding), including interference neutralization 
(canceling interference over the air) and zero forcing (canceling interference within a node). 
Later we will show by an example that both operating on a larger field and special coding at 
certain nodes are necessary for achieving capacity. It turns out that, fortunately, the number of 
nodes which are required to take special coding operation is bounded above by 4 and can be 
found explicitly. More specifically, they are usually parents of the two critical nodes and hence 
lie in two layers at most. Other than these special nodes, others can perform random linear 
coding (RLC) over the extension field. 

Related Works 

In the literature, the study of two unicast information flows over wireless networks using the 
deterministic approach begins with the investigation of the two-user interference channel [10] 
[9] [11] and its variants, including interference channels with cooperation [12] [13] [14] [15] 
and two-hop interference networks [7] [8]. Focusing on small networks (four nodes in total), 
researchers are able to characterize the capacity region exactly in the linear deterministic case 
[9] [14] [15] and to within a bounded gap in the Gaussian case [11] [14] [15], but the extension 
to larger networks seems non-trivial [7]. The present work takes a step in that direction. 

Another approach is directly looking at the Gaussian model but focusing on a cruder metric, 
degrees of freedom, instead of bounded gap to capacity. In [8], a systematic approach for 
interference neutralization called "aligned interference neutralization" is proposed for the 2x2x2 
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interference network, and it is shown that full degrees of freedom (one for each user) can be 
achieved almost surely. Later, in a recent independent work [16] such a scheme is employed and 
the authors characterize the degrees-of-freedom region of two unicast Gaussian networks almost 
surely. Interestingly, it is shown that [16] there are five possible degrees-of-freedom regions 
almost surely and they are the same as the five regions reported in this paper. The connection 
between the two results is yet to be understood and explored. These degrees-of-freedom results, 
however, rely heavily either on the assumption that there is infinite channel diversity, or on the 
rationality/irrationality of the channel gains for the scheme to work. 

The rest of the paper is organized as follows. In Section II, we formulate the problem and give 
several useful definitions. In Section III, we state our main results, and in Section IV we furnish 
examples that motivate Unear scheme based on field extension and illustrate several important 
elements in achievabiUty and outer bounds. Then we devote to details of achievability proof 
as well as outer bounds in Section V and VI, respectively. Finally, we conclude the paper by 
discussing possible extensions to more general linear deterministic networks in Section VII. 

II. Problem Formulation 

A two- source-two-destination layered network is a directed, acyclic, layered graph Q = (V, E), 
i.e. where the collection of nodes V can be partitioned into L + 2 layers (L > 0): 

L+l 
k=0 

such that for any edge (u,v) e ^, 3 /c, < < L s.t. u e £fc,v e Ck+i- The first layer 
Co = {si,S2} consists of the two source nodes, and the last layer = {di,d2} consists of 
the two destination nodes. Without loss of generality we assume each node in the network can 
be reached by at least one of the source nodes and can reach at least one of the destination 
nodes. 

For each node v e V\ {si, S2}, we define nodes that can reach v as its predecessors. Let V{\/) 
denote the set of predecessors that can reach v in one step. We will call the nodes in P(v) as 

the parents of v. Let Xu,Yu E ¥2 denote the transmission and reception of node u respectively. 
The reception of a node is the binary XOR of the transmission of its parents: = 0ugp(v) -^u- 
For example, in Fig. 3(a), the reception at node U4 will be given by Y^^ — X^^ © X^^. 
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(a) Zigzag Network (b) An Asymmetric Network 

Fig. 3. Examples 

The channel model we have used is a special case of the linear deterministic network from [4]. 
The simplification is that if there is a link from one node to another, then the channel strength 
is unity. We note that the essential nature of the linear deterministic network, namely broadcast 
and superposition, is preserved. As an example, in the network in Fig. 3(a), the transmission of 
U2 is broadcasted to us and U4, and hence the two edges (u2,U3) and (u2,U4) carry the same 
signal. The reception of U4, as mentioned above, is the binary XOR of the transmission of Ui 
and U2. 

III. Main Result 

If, for each i = 1, 2, Sj can reach dj, then it is trivial to see that the triangular rate region T 
can be achieved, and that one cannot achieve beyond the square rate region &. However, it is 
not clear under what conditions the triangular region or the square region is the capacity region. 
Our main result gives a complete answer to this question (and beyond). To state the result, we 
will need a few definitions. 

A node is Si-reachable if it can be reached by Sj. It is Si-only-reachable if it can be reached 
by Si but not Sj, j ^ i. It is SiS2-reachable if it can be reached by both Si and S2. 

For each node v G V \ {si, S2}, 

• let P(v) denote the set of parents of v that are reachable from at least one of Si, S2, 

• let V^^{\/) C V{\/) denote the set of parents of v reachable by source Sj, i = 1, 2, 

• let /C(v) := {u : 7'(u) = 7'(v)} denote the clones of v, the set of nodes that receive the 
same signal as v, 
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• let /C^*(v) := {u : 7'^'(u) —V^^{y)},i — 1,2, the set of nodes that have the same Sj- 

reachable parents as v. We called these nodes the s^-clones of v. 
The following table illustrates these sets of nodes for the node U4 in the two example networks 
in Fig. 3. For the network in (b), we assume for now that there is no edge from Si to U2. 





Fig. 3(a) 


Fig. 3(b) 


P(U4) 


{U1,U2} 


{U1,U2} 




{U1,U2} 


{ui} 




{U2} 


{U2} 


/C(U4) 


{U4} 


{U4} 




{U4} 


{U4,U6} 


/C=^(U4) 


{U3,U4} 


{U4,U5} 



For two sets of nodes Ui and U2, we say a collection of nodes T is a (Wi; W2)-vertex-cut if in 
the graph obtained from the deletion of T, there are no paths from any node in Wi \ T to any 
node in U2 \ T. Note that this definition allows T to have nodes from Ui or W2. 

We say a node v e V is omniscient if it satisfies either of (A) or (B) below: 

(A) /C(v) is a (si, S2; di)-vertex-cut and )C^^{\/) is a ($2; 0)2) -vertex-cut. 

(B) /C(v) is a (si, S2; d2)-vertex-cut and /C^^(v) is a (si; di)-vertex-cut. 
Theorem 3.1 (Characterization of%): Assume that Sj can reach dj for i = 1, 2. 

(a) If there exists an omniscient node in the network, then the capacity region is the triangular 
region T. 

(b) Conversely, if no node in the network is omniscient, then the capacity region is strictly larger 
than T. Further, the capacity region contains at least one of the trapezoid regions T12 and %2i- 
In particular, (2/3,2/3) is achievable and at least one of (1/2, 1) and (1, 1/2) is achievable. 

It turns out that we are able to give the necessary and sufficient condition for the capacity 
region to be either T12 or T21. Before describing the theorem, we need some extra definitions. 

Definition 3.1 (Critical Nodes): For each i = 1, 2, we define the critical node v| as any node 
with the smallest possible layer index such that /C(v|) is a (si, S2; dj) -vertex-cut. 

• Existence: {dj} is a (si, S2; di)-vertex-cut. 

• Uniqueness up to clones: if u,w are nodes in the same layer with /C(u) and /C(w) both 
being (si, S2; dj)-vertex-cuts, then /C(u) = /C(w), i.e. u and w are clones. 

We use to denote the layer where critical nodes v* lies, for i = 1, 2. 
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For example in Fig. 3, = U4, — 2 and V2 = d2, = 3 for both networks. 

The critical nodes defined here are directly analogous to the edges performing the "reset" 
operation in the add-up-and-reset construction of Wang and Shroff [1]. 

Below we describe one scenario where we get a result similar to the one in [1]. This lemma 
strengthens part (b) of Theorem 3.1 in this special scenario. 

Lemma 3.1: Suppose in a network S2 cannot reach di, i.e. kl — 0. Then, the capacity region 
of this network is the triangle T or the square & depending on whether there is an omniscient 
node in the network or not, i.e. depending on whether is omniscient or not (using Lemma 3.3). 
If = 0, then (1,1) can be achieved by all nodes performing random linear coding. If ^2 > 
and there is no omniscient node, then (1, 1) is achieved with high probability when all nodes 
except nodes in ^(vg) performing random linear coding over a sufficiently large field. 

Next we define cut values and min-cut on the network. 

Definition 3.2 (Cut Value and Min-Cut): Fix a set of nodes in layer k,U Q C^. Consider a 
partition of V into {T,T'^) with Si,S2 G T and U C T"^. Construct the transfer matrix G with 
rows indexed by elements of T and columns indexed by elements of T*^ where the (u, w) entry 
of G is 1 if there is a directed edge from u to w and otherwise. The rank-mincut [4] from 
{si,S2} to U is defined as the minimum rank of the transfer matrix G over all such partitions 
(T, T'^), and is denoted by C (S1.S2; W). 

The following two lemmas provide some important properties of critical nodes. Their proofs 
are left in the appendix. 

Lemma 3.2: For ^ = 1, 2, C (si, Ss; P(v*)) = 2 if k* > 2. 

Lemma 3.3: A network has an omniscient node if and only if one of the critical nodes or 
V2 is omniscient. 

Once we define the cut value, we can define primary min-cut nodes for any set of nodes U 
with C(si,S2;W) = 1, due to the following lemma. What these primary min-cut nodes receive 
determines what U receive. 

Lemma 3.4 (Primary Min-Cut): By Ui,0 < I < k, denote the set of nodes in layer Ci that 
can reach some node in U. Let 1* be the minimum index such that C{si,S2]Ui*) — 1. Then, 
lAi* C /C(u) for any u eUi*. i.e. nodes in Ui* are all clones of each other. 

We then define any of the nodes in )C{u) as the primary min-cut node of U, denoted by 
Pmc (U). It is unique up to clones. 
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Comment : Note that the reception of any node in W is a function of the reception of Pmc {U). 

For example, in Fig. 3(b) when there is an edge from Si to U2, Pmc(u5) = U2; when there is 
no edge from Si to U2, Pmc(u5) = S2. We also see that the critical node v* = Pmc(dj),2 = 1,2. 

Next, we define induced graph ^12 (w) for a node w G P^^(v*) as follows. The purpose of 
these induced graph is two-fold: 1) to capture the effect on the rest of the network caused by 
interference neutralization for (1, l)-achievability, and 2) to capture the Markov relations that 
are useful in the derivation of outer bounds. 

Definition 3.3 (Induced Graph Qu): If C (si,S2; P'^K)) = 2 then Gui^) := Q. If C (si,S2; V^^{ 
1, then we define ^12 (w) as the graph obtained by modifying only the parents of nodes in 
as follows. For u G 

\v{u) ifw^P(u) 

^ei2(w)(u) = < 

I P(u)AP^2(v*) ifwGP(u), 
where A denotes symmetric set difference: A/\B := {A\ B) U {B \ A). We then drop nodes 
in ^12 (w) that cannot be reached by either of the two sources. In the rest of this paper, a graph 
theoretic object with a graph (say, Q12) in its subscript, like 'Pgi2(w)(u) above, denote the graph 
theoretic object in the induced graph Q12. Define 7^(w) as the set of nodes in V^'^{vl) that can 
reach one of the two destinations in ^12 (w). 

Similarly we can define ^21 (w) with indices 1 and 2 swapped in the above definition. 




(a) Zigzag Network (b) An Asymmetric Network 

Fig. 4. Induced Graph for Example Networks in Fig. 3. 



For example, induced graphs for the networks in Fig. 3 are depicted in Fig. 4. For Q12 in 
(a), S2 can no longer reach d2, as U4 is omniscient in the original network Q. In (b), node ue 
becomes omniscient in Q12 while there is no omniscient node in the original network Q. 
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We will use (w) when < k2 and ^21 (w) when k2 k^. We will only use these graphs 
in relation to whether or not there is an omniscient node in ^12 (w). Lemma 3.5 below allows 
us to drop the w and refer to any of the ^12 (w) as Q12 and talk about whether or not there is an 
omniscient node in Q12. 

Lemma 3.5: Suppose, in a network with no omniscient node, and with kl < k2, there exists 
a node Wq G 7'^^(v*) such that there is an omniscient node in ^12 (wq). Then for any node 
w e 7'^^(v*), there is an omniscient node in ^i2(w). 

Theorem 3.2 (Characterization 0/T12 and %2i)-' Consider a network Q in which no node is 
omniscient. 

(a) If the network Q satisfies the following conditions, then the capacity region is the trapezoid 
region T12: 

. tS^^^: 0<kl< k*2. 

. T^^^^: C (si,S2;7''2 (v*)) = 1. Let W12 denote Pmc{V^^ (v*)). 

• T^^^^ Let U21 := Pmcg^^ (V2). U21 is omniscient in Qi2- 

• T^l'^^: W12 = S2, i.e., V^'^ cannot be reached by Si. 

We call the conjunction of the above conditions T*^^^\ Symmetrically, if Q satisfies the above 
condition with indices 1 and 2 (in the superscript) exchanged, then the capacity region is the 
trapezoid region X21. 

(b) Conversely, if neither condition T^^^^ nor T^^^^ is satisfied, then the two trapezoid regions 
are strictly contained in the capacity region. Moreover, both (1/2, 1) and (1, 1/2) are achievable 
and hence the pentagon 

Remark : Based on Lemma 3.1, if A;^ = 0, then the capacity region of this network is the triangle 

T or the square 6 depending on whether there is an omniscient node in the network. This is 

(12) 

why in T\ we need to constrain kl > 0. 

Next we give the necessary and sufficient condition for the capacity region being the pentagon 
region ^ := {{Ri, R2) : Ri, R2 >0,Ri< 1, R2 <l,Ri + R2< 3/2}. 

Theorem 3.3 (Characterization of^ and &): Consider a network Q in which no node is 
omniscient and neither T^^^^ nor T^^^^ is satisfied, 
(a) Denote the conjunction of the below conditions by P*^^^^: 

p(12) _ rp(12) p(12) _ ^(12) p(12) _ ^(12) 
•^1 — ^1 '^2 — ^2 '^3 — ^^3 

(12) 

• P4 : W12 7^ S2 and /C^^ (W12) forms an ($2; d2) -vertex-cut in Q. 
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Similarly we define condition P^^^^ with indices 1 and 2 (in the superscript) exchanged. If the 
network ^ satisfies condition P^^^^ or P*^^^\ then the capacity region is ^. 

(b) Conversely, if neither condition P*^^^^ nor P*^^^^ is satisfied, then the pentagon region is strictly 
contained in the capacity region. Moreover, (1,1) is achievable and hence the square &. 

(12) (12) 

We can easily see that T4 VP4 — {K.^^ (W12) forms an ($2; d2) -vertex-cut in Q.} and hence 
q(i2) ._ j{i2} ^ p(i2) ^j^g conjunction of the following: 

pj{12) _ ^(12) ^(12) _ ^(12) ^(12) _ ry{12) 

• Vl = il > ^2 = ^2 ' V3 = ^3 

• Q4^^^: Ar^2 (W12) forms an (S2; 0)2) -vertex-cut in 

Corollary 3.1 (Complete Characterization of Capacity): As a corollary of Theorem 3.1, 3.2 
and 3.3, we completely characterize all possible capacity regions of two unicast flows over 
the linear deterministic networks as formulated in Section n, as follows: (Short-hand notations: 
O := {3 an omniscient node}, T := T^^^Vt^^^^, P := p(i2)vp(2i), and Q := Q^^^VQ^^^^ = TVP. 
Also, in the context that no confusion will be caused, we use the same notation to denote the 
set of networks that satisfy the condition.) 



O <^ X 

T^^^) \ O I12 

T(2i) \ O ^ I21 

P \ (T U O) <^ 

Q\o <^ e 



Fig. 2 give an illustration of all these regions. 

IV. Motivating Examples 

Before going into proofs of our main result, let us visit some examples to illustrate several 
important elements in our scheme. 

A. Why Random Linear Coding Fails 

We first demonstrate, through a simple example, why random linear coding, while successful 
in achieving the capacity of single multicast over wired and linear deterministic networks [3] 
[4], cannot achieve capacity for multiple unicast. Also, by the example we will show that most 
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of the nodes in the network can perform random Unear coding and only up to four nodes are 
needed to do special linear coding. 

The example is depicted in Fig. 5(a). Random linear coding for achieving the (1,1) point, 
in the context of this example, means that each node sends out a symbol in a large field of 
characteristic 2 and each intermediate node scales its reception by a randomly uniformly chosen 
coefficient from the field, independent of others, and transmits it. How and why we lift the 
symbols from the base field F2 to a larger field will be explained later. Random linear coding 
achieves the capacity of single multicast with high probability. 

However, for two unicast if we perform random linear coding, in the network in Fig. 5(a), 
destinations di and d2 will receive linear combinations of the two symbols from sources, say 
a from source 1 and h from source 2, and their coefficients are non-zero with high probability. 
This is because both di and d2 can be reached by Si and S2. 

On the other hand, if nodes U4, U5, Ue choose their scaUng coefficients more carefully, both 
di and d2 are able to receive a clean copy of their desired symbols. This is due to the fact 
that the reception of U4 (which is the same as that of Ue) and the reception of U5 are linearly 
independent with high probability under random linear coding at all other nodes in previous 
layers, since C (si, S2; U4, U5) = 2. The scaling coefficients chosen at U4 is such that the h- 
component in the transmission is cancelled over-the-air. Because the reception of U4 and U5 are 
Hnearly independent, the a-coefficient remains non-zero. Similarly, Ue can choose its scaling 
coefficient so that d2 receives a non-zero scaled-copy of symbol h. 

We observe that in this example only nodes U4 and Uq need to perform linear coding carefully. 
It turns out that for arbitrary layered networks, at most 4 nodes need to perform special linear 
coding. 

B. Why Field Extension is Necessary 

We give an example to illustrate the Umitation if we do not use field extension and stick to 
vector Unear scheme in F2. The network is depicted in Fig. 5(a). Let the total number of channel 
uses be T, and source would like to deliver Bi bits to its own destination d,, i = 1,2. We 

consider achieving beyond the triangular region 1, and hence assume B1 + B2 > T. Therefore, at 
□2, at least Bi + B2 — T bits from each source get corrupted, while Bi — (Bi + B2 — T) = T — B2 
bits from Si and B2 — {Bi + B2 — T) —T — Bi are clean. Us's reception is just a function of what 
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(a) Network (b) Linear Scheme over F4 achieving (1,1) 

Fig. 5. Examples 

U2 receives, and hence it cannot obtain more information than what U2 possesses. In particular, U5 
cannot obtain the two length- {B i + B2 — T) chunks of bits of user 1 and user 2 that get corrupted 
at U2. If U5 does not transmit this corrupted chunk, U4 needs to supply the clean chunk for user 
1 to di and Uq needs to supply the clean chunk for user 2 to d2, respectively. But the reception 
of U4 and Ue is identical, and therefore both of them should be able to decode these two chunks. 
As their reception has at most T bits, we have 2{Bi + B2 - T) < T =^ 2Bi + 2B2 < ST. 
If U5 transmits this corrupted chunk, still U4 needs to have the clean chunk for user 2 and Ug 
needs to have the clean chunk for user 1. This is due to the property of F2. Hence we can again 
conclude 2Bi + 2B2 < ST. Therefore, we see that this linear scheme over vector space of F2 
cannot achieve beyond the pentagon ^. 

On the other hand, if instead we use a linear scheme over finite field F4, we are able to 
achieve (1,1). Recall that from the standard construction of extension field, the field F4 comprises 
{0, 1, p, p^} with the following addition and multiplication and one-to-one correspondence with 
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Therefore, we can use two time slots to translate the following scalar coding scheme over F4 
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(depicted in Fig. 5(b)) back to a nonlinear coding scheme over (F2) : a,be F4, 
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S2 


Ul 


U2 


U3 


U4 


U5 


U6 


di 


d2 


Transmits 


a 


b 


pa 


a + b 





p^a + b 


a + b 


a + pb 






Receives 
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p^a + b 


a + b 


p^a + b 


pa 


p% 



Note that since the network is layered, one can without loss of generality assume that there is 
no processing delay within a node. 

From the above example we see the benefit of working in the extension field is that, at each 
node there are more choices of scaling coefficients. In vector space {¥2)' , r > 2, the encoding 
matrix at each node has entries that are either or 1, which limits the achievable rates of such 
a scheme. 

C. Example of Networks with Different Capacity Regions 

We provide examples of networks for each of the five possible capacity regions and use them 
to illustrate the important elements in our proposed scheme (including interference neutralization 
and zero forcing). 

1) Network with capacity region T 

The example is depicted in Fig. 3(a). For achievability we know that % can be achieved 
via time-sharing between rate pairs (1,0) and (0, 1). For the outer bound, we notice that U4 is 
omniscient, and the reception of the destination di is a function of the reception of U4. This 
means U4 can decode the message of Si. The reception of each node in JC^^{[i4) — {U4.U3} is some 
function of the reception of node U4 and the transmission of Si. Since U4 can now recover the 
transmission of Si, and since )C^^{u4) forms a (S2; 0)2) -vertex-cut, U4 can recover the reception of 
d2, and thus, also the message of S2. Therefore, the sum rate cannot be greater than the maximum 
entropy of the reception of U4, which is 1. 

2) Network with capacity region I12 

The example is depicted in Fig. 3(b) (without the dashed edge). We shall use this example 
to illustrate (1/2, 1) -achievability. For achieving the rate pair (1/2,1), we use the following 
scheme: 
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Note that in the first time slot, all nodes transmit what they receive except for uq. This is because 
the reception of Ug contains a and hence it transmits instead so that d2 receives bi. In the second 
time slot, U2 has to keep silent so that U4, the critical node for di, is able to decode a. U5 hence 
receives 0, and 62 needs to be provided by Ug. Still, it is necessary for Uq to transmit a linear 
combination that does not contain a. Therefore, it makes use of the two linear combinations it 
receives over the two time slots, a + bi and a + 62, to zero-force interference a and sends out 
62 - ^i- 

To see that the capacity region is T12, we shall verify that the network satisfies T^^'^\ Obviously 
T^^^-*, T^'^\ and T4^^^ hold, as V^'^{\/1) — {U2}. Induced graph Q12 is Q with edges (u2, U4) and 
(u2, U5) deleted. It can be seen that Ue becomes omniscient in Therefore T^^^^ also holds. 

3) Network with capacity region ^ 

The example is the one depicted in Fig. 3(b) with an additional (dashed) edge (si, U2). To see 
that the capacity region is ^, we shall verify that both (1/2, 1) and (1, 1/2) are achievable and 
the network satisfies P^^^^. To achieve (1/2, 1), we use a similar scheme as above except that in 
the first time slot, U5 and uq have to carry out interference neutralization to cancel a over the 
air. To achieve (1, 1/2), we use the following scheme: 
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Note that in the first time slot, all nodes transmit what they receive except for U2. This is because 
the reception of contains b and hence it transmits instead so that U4, the critical node for 
di, receives ai. In the second time slot, U2 makes use of the two linear combinations it receives 
over the two time slots, ai + b and 02 + b, to zero-force interference b and sends out 02 — 01. 
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Meanwhile, Ui keeps silent so that Ue is able to decode b. 

For the outer bound, obviously ', P2 , and P4 ' hold, as ^^^(v^) = {U2} and W12 = U2. 
Induced graph Q12 is Q with edges (u2, U4) and (u2, U5) deleted. It can be seen that ue becomes 
omniscient in Q12. Therefore P3^^^ also holds. 

4) Network with capacity region & 

The example is depicted in Fig. 5(a). Interference neutralization happens right at di and d2, 
which is carried out by U4, U5, ue. As explained in the previous subsection, such interference 
neutralization is not possible without coding in the extension field. 

V. Proof of Achievability 

In this section, we shall establish various achievability results beyond the trivially-achievable 
triangular rate region T. We assume that in the network no nodes are omniscient and describe a 
coding scheme that achieves (1, 1), (1, 1/2), or (1/2, 1). We will use a linear scheme over the 
finite field F2t^, for some r > 0. We map the r-length binary sequences in (F2)'' to symbols in 
such that the bitwise modulo-two addition in (F2)'' translates to the addition operation in ¥2r. 
Such a mapping is always possible by the standard construction of the extension field F2r. Under 
such a mapping, we are able to abstract r usages in the original network to a single channel use 
in a network with the same topology, but with inputs and outputs in the extension field F2r. A 
node is said to perform Random Linear Coding (RLC) over F2r if the coefficient(s) chosen by 
the node in the linear transformation is chosen uniformly at random in ¥2r and independently 
of the coefficients chosen by all its predecessors. 

We will focus on schemes achieving rate pairs (1,1) and (1/2,1) respectively. To achieve 
(1,1), each source aims to convey a symbol in F2r to its own destination over one symbol-time 
slot. The block length used by each node would be r. To achieve (1/2, 1), Si aims to deliver one 
symbol while S2 aims to deliver two symbols to their respective destinations. The block length 
here would be 2r. Note that the functions transforming an incoming T-block of bits (T = r for 
the (1, l)-scheme and T — 2r for the (1/2, l)-scheme and) to an outgoing T-block of bits is 
not a linear transformation over the vector space (F2)^ and must necessarily be understood as 
operations over the extension field F2r for our proofs to work. 

A scalar linear coding scheme over F2r is specified by the following collection of linear 
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coding coefficients: {a^ e : v e V \ {di,d2}}. Define for each v e V the global coefficients 

/3v,si , Pv,s2 e as follows. 

. Initialize: /3si,si := 1, /3si,s2 := 0, /3s2,si := 0, /3s2,s2 := 1- 
• For V e V \ {si, S2}, we define 



If the messages of source Si and S2 are a and b respectively, then the reception of node 
V G V \ {si, S2} is given by /3v,si ■ a + /3v,s2 ■ b. 

Recall Lemma 3.2 and 3.3. These two lemmas explain why we define critical nodes. Lemma 3.2 
shows that the rank-influence from the sources to destination dj drops precisely at the critical 
node V* and hence, the nodes in 'P(v^) are natural candidates for special coding so as to cancel 
interference and arrange user i's symbol(s) to be received at v* even while other nodes may 
perform random linear coding. Note that this kind of special coding is a linear operation over 
the finite field F2r^ making use of the superposition feature of the channel. Lemma 3.3 shows 
that the critical nodes suffice to capture the property of existence of an omniscient node in the 
network. 

The reception of destination d^ is just a function of that of the critical node v*. Hence we 
define the cloud Cj, for i = 1, 2, to be the set of nodes that can be reached by some node in 
/C(v|) and that can reach dj. All nodes in the cloud receive functions of the reception of the 
critical node. Our scheme will ensure that v* can decode what di aims to decode, i = 1, 2. 

Below we provide several useful lemmas. Proofs of these lemmas can be found in Appendix A. 

Lemma 5.1: If u is Sj-reachable, and all its predecessors do RLC with one symbol from each 
source, then Sj's symbol has a non-zero coefficient in the reception of u with high probability. 

Lemma 5.2: Consider U Q with C(si,S2;W) = 2. Suppose each source transmits one 
symbol and all nodes in the network up to and including layer Ck-i perform RLC. 

(a) Then the nodes in U can collectively decode both of the transmitted symbols with high 
probability. 

(b) If a node v has U C V{v), then with all nodes except nodes in U performing arbitrary 
linear coding, nodes in U can arrange their transmission so that v receives any desired linear 
combination of the source symbols with high probability. 




ue-p(v) 
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(c) Let u e W C P(v). If nodes in V{\i)\U stay silent and nodes in W \ {u} do RLC, then u is 
able to arrange its transmission so that v receives any linear combination linearly independent 

of the reception of u with high probability. 

(d) As a corollary of (c), if the node u is S1S2 -reachable, then u can adjust its transmission so 
that V can decode either Si or S2's symbol with high probability. 

Lemma 5.3: IfU Q Ck satisfies C(si.S2; W) = 2, then for any u e W, we can find some w eU 
such that C(si.S2; u, w) = 2. 

Next, we shall prove achievability in different cases. Formal proofs of lemmas and claims are 
left in Appendix A. Without loss of generality, we assume that A;* < If kl = 0, based on 
Lemma 3.1 we know that if there is no omniscient node, then (1, 1) is achievable. If kl = 1, then 
by the definition of critical node vj[, both Si and S2 are v^'s parents and hence it is omniscient. 
Therefore we focus on 2 < A;* < below. We shall distinguish into two cases: kl — k2 and 

A t.* — t.* — h.* 
ji, rvj^ — th^ — 1^ 

1 ) Special Patterns Implied by the Conditions: When the critical nodes are in the same layer, 
it turns out that if the network Q satisfies the conditions given in Theorem 3.2 or Theorem 3.3, it 
has a special pattern. The fact is summarized in the following lemma. Let Vi '■— V {\/l)\V {\/2), 
V2 := V (v*) \ V (vt), 7^12 V K) n V (v*). 

Lemma 5.4: When /c* = A;* = k* and there is no omniscient node, we have the following 
equivalence relations. 

-^(12) 
( 

V\ is Si-only-reachable 

C (si, S2; V2) = 1, U21 := Pmc (P2) 7^ Si, z = 1, 2 

P12 is S2 -only-reachable 

/C^i (u2i) forms (si; di) -vertex-cut. 

p(12) ^ -p(21) 
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Vi is Si -only-reachable 

C (si, S2; V2) = 1, U21 := Pmc {V2) 7^ s„ i = 1, 2 
< C (si, S2; V12) = 1, W12 := Pmc (P12) ^Si,t = l,2 
/C^2 (W12) forms (S2; d2) -vertex-cut. 
/Cg^2 (u2i) forms (si; di) -vertex-cut in ^12. 
and the equivalence relation for T^^^) (P^^^) \Ti^^)) is the one for T^^^) (P^^^) \t(2i)) with indices 
"1" and "2" exchanged. 

Proof: Proof is detailed in the appendix. ■ 
One direct consequence of the above lemma is that, T^^^^ n T^^^^ = P^^^^ fl P^^^^ = 0. 
2) Proof of Achievability: In this case, it is sufficient to show that vj[,V2 can decode the 
symbols desired by destinations di,d2 respectively. This is because the network past layer C^* 
has no interference to dj from any node in /C(v*) for — (1,2) or (2, 1). 

By definition, we can see that /C(v*) U /C(v2) = C^*. For suppose, there exists node u e 
Ck* \ (/C(v*) U /C(v2)) . As each node can reach at least one of the destinations, u can reach 
either di or d2 thus violating the definition of a critical node. Now, suppose /C(v^) fl KL{y*2) 7^ 0' 
then 1C{m\) = IC{\/2) ^iid so, both v* and V2 are omniscient, violating the assumption. Hence 
/C(vj[) and JC{vl) form a partition of Ck*. 

Since neither nor is omniscient, V^^{\/1) 7^ V^'{\/1) and 7''2(v^) V^^{\/1). It can be 
stated equivalently as 

p=i(v*) \ P^i(v;) 7^ or P^i(v*) C P^i(v;) and 
V''(y*2) \ V''(yl) ^ or V'^ivl) C V''(yl) 

For notational convenience, let us define := V^' (v*)\P'i (v*) and := (v2)\^'' (v^). 

Below we first show that (1,1) is achievable when the network Q does not fall into any of the 
above four patterns described in Lemma 5.4. Next we show that in the patterns corresponding 
to p(i2) \t(2^) and p(2i) \t(i2)^ both (1, 1/2) and (1/2, 1) can be achieved. Finally we show that 
in the pattern corresponding to T^^^\ (1/2, 1) can be achieved, and in the pattern corresponding 
to T(2i), (1, 1/2) can be achieved. 

As a first step, we show the following claim. 

Claim 5.1: (1, 1) is achievable if Vl^ = or = or V12 = 0, under the assumption that 
there is no omniscient node. 



January 26, 2013 



DRAFT 



21 



Proof: See appendix. ■ 

In the following we focus on the case where 7^ 0, 7^2^ 7^ 0, and V12 7^ 0. We then show 
the following claim. 

Claim 5.2: Consider the conditions 

Al V Ui e , Ui is Si -only-reachable. 

A2 V U2 e V^, U2 is SiS2-reachable. 

Bl V Ui e Vl^, Ui is SiS2-reachable. 

B2 V U2 G Vf, U2 is S2-only -reachable. 
Let A = Al AA2 and 5 = 51 A 52. Then the negation of AM B implies that (1, 1) is achievable. 
Remark : Note that AV5 is implied by the disjunction of T^^^^, T^^^), P^^^^, and P^^^^. Therefore 
this claim proves (1, l)-achievability for some cases. 

Proof: See appendix. ■ 

So far we have demonstrated (1, l)-achievability when condition A V 5 is not satisfied. Since 
A and B are disjoint, we can separate into two different cases. Besides, discussion on one case 
will lead to similar arguments for the other case by symmetry. 

Case A: V ui e VW Ui is Si -only-reachable, and V U2 G ^2^, ^2 is SiS2-reachable. 

For this case, if Vi \ Vi" ^ 0, that is, there exists a node in Vi and it is S2-only-reachable, 
then C (si,S2;Pi) = 2. We can achieve (1, 1), by first arranging the transmission of P(v2) so 
that V2 can decode h and then arranging the transmission of Vi to form any linear combination 
of a and b; in particular, the one that combined with the transmission from V12 forms a at v^. If 
V2\V^ 7^ 0> that is, there exists a node in V2 and it is Si -only-reachable, then C (si, S2; 1^2) — 2. 
(1,1) is then achievable by a similar argument as above. 

We now narrow down to the case V ui G Vi, ui is Si -only -reachable, and V U2 G 1^2, ^2 is 
S1S2 -reachable. If C (si,S2;P2) = 2, obviously (1, 1) is achievable, as y\ can always get a from 
Vi (whose transmission does not affect V2) and one can arrange 7^2 8 transmission (which does 
not affect v*) to ensure decode b. If C (si, S2; 7^12) = 2, we can achieve (1, 1) by arranging 
the transmission of 7^12 so that their aggregate is a. Hence v* can decode a. Then nodes in 7^2 
just scale their received linear combinations so that a gets neutralized at V2 and only b is left. If 
C (si, S2; P12) = 1, we identify W12 = Pmc (7^12)- If /C^^(wi2) does not form a ($2; d 2) -vertex-cut, 
we can arrange its parents' transmission so that W12 can decode a, and at the same time 7^2 can 
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receive a linear combination with a non-zero 6-coefficient. Hence nodes in V12 can send out a 
scaled version of a to neutralize a at V2 if necessary, and v* can always obtain a from Vi. 

So far we have shown that in Case A, if one of the following is violated, then (1,1) is 
achievable: 

• Vi is Si -only-reachable 

• V2 is SiS2-reachable, and C (si, S2; V2) — 1 

• C (si,S2;7'i2) = 1, /C^^(wi2) forms a ($2; d2) -vertex-cut 

To complete the proof of (1, l)-achievability, we need to show that if U21 := Pmc (P2) is 
not ommiscient in Q12, then (1, 1) can be achieved. We can simply arrange the transmission of 
P12 so that their aggregate becomes at v^. Effectively we are in O12 with this special linear 
coding operation. Since in Q12, di is Si -only-reachable and U21 is the new critical node of d2, 
by Lemma 3.1 we know that (1, 1) can be achieved in Q12. We then translate the linear coding 
scheme in Q12 back to a linear coding scheme in Q. 

The next thing to show for Case A: if a network is in P*^^^-' \ T*^^^-*, then (1,1/2) can be 
achieved. To show it, we employ a two-time-slot coding scheme. We aim to deliver two symbols 
ai and 02 for user 1 and one symbol b for user 2 over two symbol time slots. Symbols are 
drawn from the extension field ¥2r. In the first time slot, we do RLC with Si transmitting oi 
and S2 transmitting b, up to layer jCk*-i- Pick one node w e Vu and one node u e 7^2- Keep 
other nodes in Vu and V2 silent, while nodes in Vi do RLC. We turn off the transmission of w. 
V* can then decode ai. In the second time slot again we do RLC with si transmitting 02 and S2 
transmitting b, up to layer We use the two linear combinations w receives over the two 

time slots to zero-force (ZF) b and produce a linear combination of Oi and 02: (the superscripts 
of /3's denote the time indices) 



w then scales this ZF output and sends it out. Hence vj[ can use oi as side information to decode 
a2. 

As for user 2, in the first time slot V2 receives a linear equation from u: ^ufs\ • oi -|- ■ b. In 

(2) (2) 

the second time slot u receives /3u,si ■ 0-2 + /3u,s2 ■ b- u makes use of of the two Unear combinations 




(1) 
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to zero-force b and generate a linear combination of oi and 02: 

P^l ■ «i + Pil ■ b; /3S • «2 + • b 

ZF ^(2) , Pu,si ^(2) /ox 

^ PI A ■ ^2 + -(i^ ■ /3i,s; • ai- (2) 

Pu,S2 

As long as the two linear combinations in (1) and (2) are not aligned, u can scale (2) properly 
to form ai at in the second time slot. Then with reception of the first time slot, can decode 
b. 

The two linear combinations in (1) and (2) are aligned if and only if the determinant 



/Jw,si 


gW 


A>'W,S2 


a{2) 
Pu,si 


g(lf 
Pu,si 

Pu,S2 


Pu,S2 



= 



fl(2) «(2) ^ o{l) o(l) 0(2) o{2) 
^'^U,Sl^^W,S2'^W,Sl^'^U,S2 ^'^U,S2^^W,Sl^'^W,S2^^U,Sl ' 

which is of very low probability due to the same reason in Appendix B. 

Therefore, we show that in Case A, if T*^^^^ V P'-^^-' is violated, then (1, 1) can be achieved; if 
j(i2) violated, then (1, 1/2) can be achieved. It remains to show that if there is no omniscient 
node, then in Case A, (1/2, 1) is always achievable. 

We aim to deliver one symbol a for user 1 and two symbols 61, 62 for user 2 over two time 
slots. Pick nodes Ui e Vi, U2 e 7^2,^2 e 7^12. Both U2 and W2 zero-force user I's symbol a and 
form a linear combination of 61,62- These two Unear equations are linearly independent with 
high probability, as shown in Appendix B. W2 transmits in the first time slot, while Ui and U2 
transmit in the second time slot. Therefore can obtain a, can solve 61 and 62, and (1/2, 1) 
is achievable. 

Case -B: V U2 G 7^2^ ^2 is S2 -only-reachable, and V ui G Vi\ ui is SiS2-reachable. 

Similar to Case A, we show that in Case B, if T*^^^-* V P*^^^-* is violated, then (1, 1) can be 
achieved; if T^^^^ is violated, then (1/2, 1) can be achieved. Besides, if there is no omniscient 
node, then in Case B, (1,1/2) is always achievable. 

B. kl < kl 

Since v* is not omniscient, 10'^{\j\) does not form a ($2; d2) -vertex-cut, which is equivalent to 

3 U2 e At \/C(v*) so that V''{u2) ^ 0,P^^(u2) ^ P^^(vt). 
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The following lemma makes sure that U2 can still receive a linear combination where user 2's 
symbol has a non-zero coefficient with high probability even if ^^^(v^) do some special linear 
coding. 

Lemma 5.5: Consider all nodes doing RLC for each source sending one symbol up to Cki-i 
including £fe*_i, except V^'^{^\). If P^^(u2) 7^ V^^{^\), then it is possible with high probability 
that V^'^{y\) can arrange their transmission so that v* receives a Unear combination solely of 
user I's symbol and U2 receives a linear combination of at least user 2's symbol, that is, the 
coefficient of user 2's symbol is non-zero. 

1) (1, l)-Achievability: For the (1, l)-achievability we need to prove the following claim 

Claim 5.3: -iQ^^^^ =^ (1, 1) is achievable. 
Proof: Since Q^^^^ is satisfied, in a network that does not satisfy Q*^^^\ at least one of the 
following holds: 

. C(si,S2;7'^^K)) = 2 

• C (si, S2; 'P^'^{y\)) = 1 and /C^^^ (u2i) does not form an (si; di) -vertex-cut in Q12 

• C (si, S2; P^2(v^)) = 1 and /C^^^ (u2i) forms an (si; di)-vertex-cut in Q12 and 10'^{v^i2) does 
not form a ($2; d2)-vertex-cut in Q 

Case 1: C (si, Ss; ^^^(v*)) = 2 

In this case, the idea is to arrange the transmission of V^'^{\i\) so that their aggregate contains 
user I's symbol a only. Mathematically, we aim to have 

w67'=2(v*) we'P=2(v*) 

This is doable since C (si, S2; 7^^^(v![)) = 2. Other nodes in the same layer simply do RLC. 
Therefore v* is able to decode a. Nodes in Ci do RLC and di can decode a. 

As for user 2, we look at v^. If has no parents in the cloud Ci, we only need to guarantee 
that the parents of V2 can collectively decode b. If V2 has some parent(s) in the cloud Ci, the 
parent(s) will inject user I's symbol a to the reception of As V2 is not omniscient, there 
must exist Ui e nCi such that V{ui) ^ V^^iy*^. If V{wx) C V^^iy^^), we can arrange the 
nodes in V{}^\) to make sure that Ui can decode user I's symbol, and then arrange the nodes 
in V^^iy*^) \ 'P(ui) to neutralize user I's symbol at V2, given that these Si-reachable nodes can 
still receive a linear combination with non-zero a-coefficient under the special coding carried 
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out by V^^{yl). Then since some node in V{\/2) will receive a linear combination with non-zero 
6-coefficient (eg., a successor of U2 in Lemma 5.5), one can always ensure V2 to decode b. If 
'P(ui) \ V^^{\/2) 7^ 0, we can arrange the nodes in V{yl) to form a linear combination that only 
contains b at V2 given that the reception of V(\/2) can collectively decode b. Then use nodes in 
P(ui) \ P^^(v2) to place user I's symbol at ui if necessary. 

In summary, we want to guarantee that under the special linear coding carried out by V^^{\/1) 
so that the neutralization criterion (3) is met, V{\/2) can still collectively decode b and every 
node in V^^{\/2) receives a linear combination with non-zero a-coefficient. The latter is quite 
obvious, as nodes affected by the special linear coding still receive linear combinations with 
non-zero a-coefficients. As for the former, note that if every node up to layer ^2 ~ 2 does RLC, 
it holds with high probability since C (si, S2; P(v2)) 2. With the special Unear coding carried 
out by V^^{\/1) described above, however, we cannot claim it with the existing random linear 
network coding argument. 

We shall use the following two lemmas to overcome the difficulty, by breaking the network 
into two stages: one from the source layer to the layer and the other from layer Ck* to layer 
The first lemma claims that, under the special operation at 'P^^(vJ) so that neutralization 
criterion (3) is satisfied, with high probability all nodes in layer C^i that can reach 62 (call 
this set U) receive a non-zero linear combination of a and b, and the subspace spanned by their 
reception has dimension two when all other nodes perform RLC. The second lemma claims that, 
once U's reception satisfies the above property, then V{\/2) can collectively decode both a and 
b with high probability, when all nodes between jCk* and JOk*-i perform RLC. The lemmas are 
made concrete below. 

Lemma 5.6 (Reception ofU): Let us recall that W := {u G : u can reach di}. Consider 
RLC with Si transmitting a and S2 transmitting b. All nodes perform RLC up to layer Cki-i. 
In Cki-i, nodes except V^'^{^\) also perform RLC. Then under special coding operation of 
V^'^{^\) such that neutralization criterion (3) is satisfied, with high probability all nodes in U 
receive a non-zero linear combination of a and b, and the subspace spanned by their reception 
has dimension two. Further, if node u e W is Si -reachable, then its reception has a non-zero 
coefficient of Si's symbol a with high probability. 

Lemma 5.7 (Rank Conservation): Suppose U and V are the first and the last layers of a linear 
deterministic network and each node u e W possesses a linear combination of the symbols a, b 
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given by Au • a + //u • 6. Suppose 

• each node in U can reach some node in V, 

• C {U; V) > 2, 

• for each u e we have Au, /Xu not both 0, 

• the |W| X 2 matrix with rows given by Au //uj for ^ach u e W has full rank (i.e. rank 2). 
If all nodes in the network perform RLC, then nodes in V can collectively decode both the 
symbols a and h with high probability. 

Case 2: C {si,S2]V^'^{y\)) — 1 and ICg^^ (u2i) does not form an (si; di) -vertex-cut in Q12 

In this case, since C (si, S2; 7'^^(v*)) = 1, effectively they receive only one linear equation 
of a and h. Since V^'^{\i\) can be reached by S2, the coefficient of h in this linear equation is 
non-zero in general. Hence we need to arrange their transmission so that ^vve7''^2(v*) = 0, 
that is, 

Q;w/5w,si = ^ Ol^Pw,S2 =0, (4) 

we'P^2(v*) weP=2(v*) 
Since C (si, S2; 7^(v^)) = 2, v* must have some Si -only-reachable parents. Therefore v* can 
decode a. 

With such special operation in V^^ivl), effectively we are in the induced graph Qi2- In other 
words, any linear coding scheme in the induced graph Q12 can be translated to a linear coding 
scheme in Q satisfying the neutralization criterion (4), in the sense that the reception of dj 
remains the same in both schemes, for i — 1,2. In Q12, note that di can only be reached by Si 
but not S2. Hence by Lemma 3.1, as long as the critical node for destination d2 in Q12, ^21, is 
not omniscient, (1,1) is achievable. U21 is not omniscient in Q12 by the assumption of this case. 

Case 3: C (si, S2; P^^(vjf)) — 1 and ICg^^ (u2i) forms an (si; di) -vertex-cut in Q12 and /C^^(wi2) 
does not form an ($2; d2) -vertex-cut in Q 

In this case the idea is to enable W12 to decode user I's symbol a while keeping user 2's flow 
to V2, making use of the fact that /C^^(wi2) does not form a ($2; d2) -vertex-cut in Q. Effectively 
we impose the neutralization criterion on W12 instead of v^, and carry out the special coding 
operation at V^'^{\ni2) instead of V^'^{yl). 

As for user 1, obviously W12 7^ S2, and hence it can be reached by Si due to the definition 
of critical nodes. Since C (si, S2; P(wi2)) = 2, we can enable W12 to decode a by satisfying the 
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following neutralization condition: 



Qiw/?W,S1 /^'P(W12),! 




(5) 



we'P(wi2) 



we'P(wi2) 



Once Wi2 decodes a, it simply sends out a scaled copy of a. With all other nodes performing 
RLC up to layer Ck*-i (including P^^(vj[)), critical node can decode a. 

As for user 2, note that depending on the value of C (si, S2; ■P^^(wi2)) being 2 or 1, /5p(wi2),si 
is either non-zero or zero. If C (si, S2; 7'^^(wi2)) = 2, we use the two lemmas. Lemma 5.6 
and 5.7, in the first case to show that the parents of can recover both user's symbols with 
high probability under the special operation at V^'^(\ni2). If C (si, S2; V^'^{\ni2)) = 1, we construct 
another induced graph to capture the constraints that such special coding lays on the reception 
of other nodes in the same layer as W12, which is similar to Q12 in the second case. In Q[2, the 
critical node for user 2 may no longer be V2, as the min-cut value from the sources {si, S2} to 
the parents of may drop to 1. Note that as in Q12, destination di is now Si -only-reachable in 
Q[2- Hence we only need the new critical node for destination d2 is not omniscient in Q[2- 

The following lemma guarantees it in this case. 

Lemma 5.8: In this case (Case 3) when C (si, S2; P^^(wi2)) = 1, for all possible Q'12, the 
Si-clones of Pmcg/^ {62) do not form a (si; di)-vertex-cut. 

Combining the above three cases, we complete the proof for the claim and the (1, l)-achievability. 

■ 

2) (1, l/2)-Achievability: For the (1, l/2)-achievability we need to prove the following claim 
Claim 5.4: P^^^^ =^ (1, 1/2) is achievable. 

Proof: Consider two cases, distinguishing whether V2 has parents from the cloud or not. 

1) V{v*) nCi 7^ 0: Under the condition that 7'(v;) nCi 7^ 0, we know that in the critical node 
for d2 is still Vg, as Cg^j (si, S2; ^512(^2)) = 2. This is because nodes in the cloud Ci become 
Si -only-reachable in Q12 while some nodes in 7^512(^2) S2-reachable in Q12. P*-^^^ implies 
that the Si-clones of V2 in Q12 becomes a (si; di) -vertex-cut. Therefore, some nodes in 'P(v2) 
must be dropped in generating Q12 (as they cannot be reached by either one of the sources), and 



We aim to deliver two symbols oi, 02 for user 1 and one symbol b for user 2 over two symbol 
time slots. Symbols are drawn from the extension field ¥2r. In the first time slot we do RLC with 
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Si transmitting oi and S2 transmitting b, up to layer jC^i-i. Then we arrange the transmission of 
V^'^i^l) so that their aggregate becomes zero, as in Case 2. v* can hence decode ai, and transmit 
a scaled version of it. The rest of the nodes keep performing RLC. It is as if the communication 
is over the induced graph and effectively nodes in V{v2) \ ^012(^2) ^^^^ receive nothing. As 
the Si-clones of V2 form a (si; di) -vertex-cut in O12, V2 will receive a linear equation of ai and 
b, and both symbols have non-zero coefficients. Therefore, di can decode oi in the first time 
slot. 

In the second time slot, we do RLC with Si transmitting 02 and S2 transmitting b, up to the 

layer right before W12. For those nodes in /C(wi2) that can reach P^^(vJ), instead of scaling their 
reception and transmitting it, they replace their reception by a linear combination of ai and 02. 
This linear combination is obtained by zero-forcing b using the reception of the first and the 
second time slot: 

^£ls. • «i + /3S,S2 • b; • a2 + /3S,S2 • b 

ZF r)(2) , Pwi2,Si r,(2) 

=^ /^iisi • «2 + ■ /3iis2 • «1- 

Pwi2,S2 

The rest of the nodes perform RLC up to layer Since already obtains oi in the first time 
slot and it receives a linear combination of a 1, 02 with non-zero 02 -coefficient in the second time 
slot, it can decode 02. Onwards it transmits a scaled copy of 02, while other nodes perform RLC. 
The nodes in P(v2) \ 'Pgi2(v2), unlike in the first time slot, will receive a linear combination 
of ai,a2, which is a scaled version of that transmitted by W12. Hence, we can armage the 
transmission of V{v2) \ ^512(^2) and 'P(v2) fl Ci so that V2 can decode oi. Therefore, using the 
reception from the first time slot, V2 can decode b. 

2) 'P(v2) n Ci = 0: We aim to deliver two symbols ai and 02 for user 1 and one symbol b for 
user 2 over two symbol time slots. Again the symbols are drawn from the extension field ¥2r. In 
the first time slot, we do RLC with Si transmitting oi and S2 transmitting b, up to layer jCk^-i- 
Then we arrange the transmission of V^'^{\/1) so that their aggregate becomes zero, as in Case 
2. It is as if the communication is over the induced graph Q12. Since U21 is the critical node for 
the parents of V2 in Q12, in the first time slot the they effectively receive only one equation 



January 26, 2013 



DRAFT 



29 



where /^ual.si is non-zero with high probabiUty since JCg_^^ (u2i) forms a (si; di) -vertex-cut in Q12 
and hence U21 must be reachable by Si. /3u2!,s2 is non-zero with high probabiUty since is not 
omniscient and hence S2 must be able to reach V2 in Q12. 

In the second time slot, we do RLC with Si transmitting 0,2 and S2 transmitting b, up to the 
layer right before W12. For those nodes in /C(wi2) that can reach V^'^{\/1), instead of scaling their 
reception and transmitting it, they replace their reception by a linear combination of oi and 02. 
This linear combination is obtained by zero-forcing b using the reception of the first and the 
second time slot: 



/?£l,s, • «i + pL%. ■ ^; /^S,si • «2 + /3S,32 • b 



^ /9(2) 



Wl2,Sl 



W12,S2 



ai. 



The rest of the nodes remain doing RLC, up to the layer right before V2. In the second time slot, 

V2's parents receive at least two linear equations in {01,02,6}. Pick two nodes u,w G ^^(vg) 
such that C (si, S2; u, w) = 2. Let their reception be 

^u,ai • Oi + ^u,a2 • 02 + ^u,h ' b, 
/5w,oi ■ ^1 + /5w,a2 ■ ^2 + /3w,b ■ b, 

respectively. We shall show that the following determinant 



PU21,Sl 

/^w,ai 



"21, S2 






PU21,S2 




f3u,b 


/5w,a2 








/^w,ai 


/^w,a2 



(6) 



21,Sl 



/^w,a2 



is non-zero with high probability. 

Note that in the second time slot, we choose the scaling coefficients a's for all nodes up to 
the layer right before V2 in the same way as RLC. The only difference from RLC is that at 

the nodes in /C(wi2) that can reach V^'^ivl), the term scaled and transmitted is replaced by the 

(2) 0^^^ (2) 

zero-forced output /3wi2,si • 0,2 + "if ''^ • /3wi2,s2 • oi. Suppose we do RLC, then u and w will receive 

/^™12 .=2 

Pi% ■ «2 + ■ b, and ■ 02 + ■ b 
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respectively, where D^"^^ 



q{2) n(2) 



7^ with high probability since C(si,S2;u,w) = 2. 



As pointed out above, from the connection of the scheme to RLC, we see 



where 



D 



/o(l) 

Pwi2,si ^(2) 
A>'wi2,S2 



(2) 



= D 



(2) 
R ' 



and 



D 



(2) 
R 



Pu,si 


"^(2) " 
Pu,S2 








^(2) 


^^(2) " 




Pw,si 


/Jw,S2 






z 
















/-'w,S2 









Here 



PU,S2 



denotes the coefficient of b that u receives under a virtual RLC with the same 



J R 



coding operation as regular RLC except that nodes in /C(wi2) that can reach 'P^^(v^) (call this 
set Z) are transmitting scaled copies of a (with the same scaling coefficient as in regular RLC) 



instead of a linear combination of a, b. 



«(2) 
Pu,S2 



denotes the coefficient of b that u receives 



J z 



under a virtual RLC with the same coding operation as regular RLC except that the S2-reachable 
predecessors of u in the same layer as W12 other than Z are transmitting scaled copies of the 
a-components in their reception (with the same scaling coefficient). Note that if there is no S2- 



reachable predecessor of u in Z, then 
in (6) equals to zero if and only if 



/^U,S2 



0. We have D 



(2) 



-D 



(2) 
R 



D'^'^K The determinant 



/^Wl2,Sl 
/-'U21,Sl 



/^Wl2,Sr 



/3, 



(1) 

U21,S2 



/-'u21,S2^^Wi2,Si-^Z ^ /^U21,SiA^Wi2,S2-^il " 

is a zero polynomial, then we are done since D^^^ 7^ with high 



Suppose 

probability. 

(2) (2) 

Note that D^^' and D}^^^ cannot simultaneously be zero with high probability, as their sum 
is non-zero with high probability. First assume that 7^ 0. The determinant in (6) equals to 
zero if and only if 



D 



(2) 
R 



D 



(2) 



PU21,S2PWi2,Sl 
/-'U21,Sl/^Wi2,S2 
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RHS and LHS are independent. We only need to consider the case 




is not a zero 



polynomial. The probability distribution of RHS is "almost" uniform and there is no particular 
value at which it has a non- vanishing probability (see Lemma B.l in Appendix B). Hence the 
above equality happens with vanishing probability. 



3) (1/2, 1)-Achievability: For the (1/2, l)-achievability, we argue that if there is no omniscient 
node, then (1/2, 1) is achievable. We shall use nodes reachable from U2 in V{^2) to provide user 
2's symbols. Define the collection of these nodes by <Sjt*_i(u2). Consider the following two 
cases. 

1) Vi^l) n Ci 7^ 0: If Q^^^) is violated, (1, 1) can be achieved and so can (1/2, 1). Hence we 
focus on the case in which Q^^^^ is satisfied. Under the condition that Viy"^ fl Ci 7^ 0, from the 
analysis of the previous case we know that some nodes in P(v2) must be dropped in generating 
6;i2, andPg,,(v*)^P(v*). 

We aim to deliver one symbol a for user 1 and two symbols hi , 62 for user 2 over two time 
slots. In the first time slot, all nodes up to layer — 1 perform RLC with Si transmitting a 
scaled copy of a, and S2 transmitting a scaled copy of 61, except that nodes in 'P^'^{^\) perform 
special linear coding to make sure their aggregate transmission is zero. Hence effectively we are 
in Q12, and the nodes in '^'^^^^(^z)' which form a (si; di) -vertex-cut in Q12 and therefore lie in 
the cloud Ci, can decode a. Since Cg-^^ (si, S2; ^5^2(^2)) = 2, we can arrange the transmission 
of Vg^^i^'^) so that V2 can decode hi and so can d2. But di will receive nothing, as KL^g^,^{M2) 
is a (si; di)-vertex-cut in Q12. In the second time slot, all nodes up to layer — 1 perform 
RLC with si transmitting a scaled copy of a, and S2 transmitting a scaled copy of 62- This time 
the nodes in 7'(v2) \ 'Pg-^^{y2) will receive a non-triavial Unear combination of a and 62 with a 
non-zero a-coefficient. Then we let nodes in 7^512(^2) transmit a scaled copy of a by choosing 
their scaling coefficients uniformly and independently, while using nodes in 'P(v2) \ Vgy^{y*2) 
to neutralize the symbol a in the reception of and obtain a clean copy of b2. Hence di can 
decode a, and d2 can decode 62 in the second time slot. 

2) 'P(v2) n Ci = 0: We aim to prove that (1/2, 1) is achievable in this case. User 1 has one 
symbol a and user 2 has two symbols hi, 62 to be delivered over two time slots. 



Similar conclusion can be drawn in the case D 



^0. 
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In the first time slot, all nodes up to layer k2 — 1 perform RLC with Si transmitting a scaled 
copy of a, and S2 transmitting a scaled copy of bi. Note that because C (si, S2; 'P(v2)) = 2, 
we have that V{v2) '^^^ collectively decode both a and bi due to Lemma 5.2(a). In the second 
time slot, all nodes up to layer kl — 2 perform RLC with Si sending a and S2 sending 62- Due 
to Lemma 5.2(a), we can arrange the transmission of P(vj[) so that receives only a in the 
second time slot, since C (si, S2; 7'(v*)) = 2. As C V^^{u2) ^ 'P^^(vi), U2 receives a linear 
combination with a non-zero coefficient of user 2's symbol due to Lemma 5.5. Further, all nodes 
perform RLC up to layer 1. As U2 has a path to 'P(v2), some node in P(v2) receives a 
linear combination of the three symbols with a non-zero coefficient for 62- Thus, 'P(v2) can 
collectively decode all three symbols 0,61,62- Since this decoding is a linear operation, these 
nodes can arrange their transmissions so as to form 61 and 62 at Vg's reception in first and second 
time slots respectively. All nodes in layer onwards perform RLC with no mixing across time 
slots. Thus, d2 can recover both 61 and 62- As nodes in nCi perform RLC with no mixing 
across time slots, destination di can recover both the symbols a and 61. 

VI. Proof of Outer Bounds 

A. Outer Bound on Ri + R2: the Omniscient Bound 

We show that if a node v is omniscient, then it can decode both user's messages and hence, 
the achievable sum rate is upper bounded by 1. This explains the motivation for the name. 
Let V be omniscient and satisfy condition (A) in the definition of omniscient nodes: /C(v) is a 
(si, S2; di) -vertex-cut and is a (S2; d 2) -vertex-cut. Since /C(v) is a (si, S2; di)-vertex-cut, 

the reception of the destination di is a function of the reception of v. This means v can decode 
the message of Si. The reception of each node in ]0'^{m) is some function of the reception of 
node V and the transmission of Si. Since v can now recover the transmission of Si, and since 
/C^2(v) forms a (S2; d2) -vertex-cut, v can recover the reception of d2, and thus, also the message 
of S2. We leave the formal proof of this outer bound in the appendix. 

B. Outer Bounds on 2Ri + R2 and Ri -\- 2i?2 

We want to show that if the condition T*^^^^ is satisfied, then 2Ri + R2 <2 for any achievable 
(i?i,i?2)- We first show the following claim. 

Claim 6.1: If there exists random variables {^1,^21, Z22} in the network satisfying 
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1) H{Z,) < 1,H{Z^,) < l,HiZ22) < 1. 

2) X,^ ^ ^ and X^^ o {Zii, Zg) ^ Yf^ 

3) Xi'^^iZ.^^Xi'J^Yf^ 

4) H {Zf\X^^) > H (Z^,) 

5) Zg is a function of 

then 2Ri + R2 <2 for any achievable {Ri, R2). 
Proof is detailed in the appendix. 

We shall use the above claim to complete the proof of the outer bound 2Ri + R2 < 2. We 
set Zi ■.= Yy*, Z21 := Y^^,^^, Z22 '■= Z]weP='2(v*) 

• Hence by the definition of the channels, condition 1) of the claim is satisfied. 

• By the definition of v*, we see that the first Markov chain in condition 2) is satisfied. By 
condition T^^^^ and the definition of the induced graph Q12 we see that the second Markov 
chain is also satisfied. Hence, condition 2) is satisfied. 

(12) (12) 

• By conditions T3 and T4 , we see that the Markov chain in condition 3) is satisfied. 

(12) 

• Condition 4) is satisfied with equality due to the definition of Z22 and condition T4 ' . 

• Condition 5) is satisfied due to the definition of Z22 and conditions T2^^^ and T4^^''. 
Similarly, if the condition T^^^^ is satisfied, then Ri + 2i?2 < 2 by symmetry. 



C. Outer Bound on 2Ri + 2i?2 

We want to show that if the condition P*^^^^ is satisfied, then 2Ri + 2R2 < 3 for any achievable 

R2). We first show the following claim. 
Claim 6.2: If there exists random variables {Zn, Z12, -^21,-^22} in the network satisfying 

1) H{Z^{) < 1, H{Z^2) < 1, H{Z2i) < 1, H{Z22) < 1 

2) X^^ ^ Z^, ^ Yil and X^ ^ (Z^^, Z^,) ^ Y^^ 

3) X,^^(Z2^,Z2^,Xi^)^F,>nd 

4) H {Z^,\X^^) > H {Zg\X^^) 

5) Z22 is a function of Z^^ 

then 2Ri + 2R2 < 3 for any achievable {Ri, R2). 
Proof is detailed in the appendix. 
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We shall use the above claim to complete the proof of the outer bound 2Ri + 2R2 < 3. We 
set Zii := Fvi, ^12 '■= Ywrz^ ^21 '■= ^U2i5 ^22 '■= XlweP^z^vj) 

• By the definition of the channels, condition 1) of the claim is satisfied. 

• By the definition of vj[, we see that the first Markov chain in condition 2) is satisfied. By 
condition P^^^^ and the definition of the induced graph Q12 we see that the second Markov 
chain is also satisfied. Hence, condition 2) is satisfied. 

(12) 

• The first Markov chain in condition 3) is due to condition P3 ' and the definition of the 
induced graph Q12. The second Markov chain is due to condition P4^^^. Hence condition 3) 

is satisfied. 

• Condition 4) is satisfied with equality due to the definition of Z22. 

• Condition 5) is satisfied due to the definition of Z12, Z22 and conditions P2^^^ and P4^^\ 
Similarly, if the condition P^^^^ is satisfied, then 2it!i + IR2 < 3 by symmetry. 

vn. Concluding Remarks 

In this paper, we completely characterize the capacity region of two unicast information flows 
over a layered linear deterministic network with base field F2 under the unit-channel strength 
assumption. It turns out that when each source can reach its own destination, the capacity region 
is one of the five: the triangle T, the trapezoids Xi2,T2i, the pentagon and the square S. 
The necessary and sufficient condition for the capacity region to be one of them elucidates when 
and how the connectivity of the network Umits the amount of information deliverable to the 
destination under the presence of the other interfering information flow. 

Our result extends to a more general linear deterministic channel setting where a general 
matrix in F2 (not necessarily a shift matrix) is associated to each edge in the network. Such 
generalization is made possible by looking at entries of the receive/transmit vectors, called 
"bubbles", and redefining omniscience, clone sets, parents, cuts, etc., for bubbles. This result 
will be detailed in a later version of this paper. 
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Appendix A 
Proof of Lemmas and Claims 

By the phrase "with high probability", we mean a probabiUty that goes to 1 as the size of the 
field goes to infinity. 
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A. Proof of Lemma 3. 1 

If A;^ = and k2 = 1, then both Si and S2 are V2's parents, and obviously V2 is omniscient, 
violating the assumption. Hence, k2 — or k2 > 2. If k2 = 0, then there is no interference at 
destination di from source S2 and vice versa. In this case, clearly (1,1) is achievable. 

If k2 > 2, we shall show that (1, 1) can be achieved provided that there is no omniscient 
node. Nodes do RLC with Si transmitting a scaled copy of symbol a e and S2 transmitting 
a scaled copy of symbol b G ¥2r, until layer jCk*-i. By definitions of and Ci, layer Ck* is 
partitioned by /C(v2) and Ci (1 Ck*. Since V2 is not omniscient, 

3 ui e Ci n Cki such that V{ui){^ V{ui)) ^ Vi^l). 

Note that since ui e Ci, P^i(ui) = 'P(ui). Also note that all nodes in C\ are Si-only-reachable. 
Consider the following two cases: 

1) ■P(ui) \ V^^{^2) 7^ 0- this case we arrange nodes in V{^2) so that user 2's symbol h can 
be decoded at V2. Then use nodes in P(ui) \ '^^^(vg) to provide user I's symbol a at Ui 
if necessary, ui and V2 and their successors do RLC. 

2) V{ui) C 'P^^(v2). In this case we first let nodes in P(ui) do RLC and place user I's 
symbol a at ui. Then, use nodes in P^^(v2) \P(ui) and nodes in P(v2) to neutralize user 
I's symbol a and place user 2's symbol h at Vg. Ui and V2 and their successors do RLC. 

Hence, (1, 1) is achievable when A;* = 0. 

B. Proof of Lemma 3.2 

Suppose i — 1. Suppose C (si, S2; P(vj[)) ^ 2. It cannot be larger than 2 by definition and it 
cannot be because {si,S2} has paths to V{y\). So, suppose C (si, S2; 7^(v^)) = 1. 

Let ^ C V be the set of nodes in the graph that can be reached by {si,S2} and can reach 
'P{mX)- Let Q' be the graph induced by nodes in A and for U Q A, let Cgi (si, S2]U) denote the 
mincut from {si,S2} to U in the graph Q' . Then, obviously Cgi (si, S2; 'P(v^)) = 1. 

Note that for any partition of the vertices of A into {B,A \ B) with {si,S2} C B,V{y*i) — 
A\B, if there exist nodes in the same layer ui, U2 G A such that ui E B and U2 G A\B, then 
the rank of the transfer matrix across the cut {B, A\B) is at least 2. Thus, if there exists a cut 
{B,A\B) of value 1, then the cut must be of the form B — (U*^q>C;) n A, for some i > 0. 
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This tells us that if u e AoCt+i, then /C(u) D AoCt+i, so that /C(u) is a (si,S2;di) -vertex-cut 
violating the definition of critical node v*. Hence we complete the proof by contradiction. 

C. Proof of Lemma 3.3 

Suppose node v is omniscient, say /C(v) is a (si, S2; di)-vertex-cut and /C^^(v) is a (S2; d2)- 
vertex-cut. Suppose vl is not omniscient. As /C(v) is a (si,S2; di)-vertex-cut, we have that either 

V e /C(vj[) or that v lies in a layer £fe with k > k{. This follows from the definition of the 
critical node v^. In the first case, we automatically have that is omniscient. So, suppose v lies 
in layer with k > k^. Then, since is not omniscient, there exists a path from S2 to d2 with 
a node u^* in layer and a node in layer Ck such that V^'^{y\) ^ V^^{uki). Since node 

V is omniscient, we must have that ^^^(v) = V^^{uk). But this is impossible since has an 
S2 -reachable parent from the path that does not lie in the cloud Ci which contains all the parents 
of V. This contradiction establishes that m\ must have been omniscient. 

D. Proof of Lemma 3.4 

First note that if we restrict attention to the induced subgraph Q' obtained by deleting all 
nodes which can either not reach the set of nodes U or cannot be reached by at least one of Si 
and S2, then the mincut value C (si,S2;W) is preserved. Since each node can be reached by at 
least one of Si or S2, we only have to delete nodes that cannot reach some node in U. 

Now, we are looking at a graph where the set of nodes in layer Hs for < Z < A; and U 
for layer k. 

Consider, for this graph, the set of all vertex bipartitions between {si,S2} and U which yield 
a transfer matrix of rank 1. All such bipartition cuts must be 'vertical', i.e. they are partitions of 
the form [A^A"^) where A — for some 1,0 < I < k. This is because any non- 'vertical' 

cut yields a transfer matrix of rank at least 2. This establishes that the parents sets of all nodes 
in Ui* are identical in this graph and so, also in the original graph because every node in the 
new graph Q' has the same parent set as in the original graph. This concludes the proof of the 
lemma. 

E. Proof of Lemma 3.5 

We are in the scenario where C (si, S2; 'P^^(v^)) = 1. Consider Quivj) for some node w e 
7^^2(vjf) and suppose that there is no omniscient node in ^12 (w). As ^12 (w) has no paths from 
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S2 to di, by Lemma 3.1, we can achieve (1, 1) in ^i2(w), with high probabiUty, by all nodes 
except nodes in 'P(v2) performing RLC. Then, with high probability all nodes in 7-'^^(v^) receive 
a non-trivial linear combination and each has a non-zero coefficient of symbol b sent by S2. Take 
any such (1, 1) achieving scheme and any other node w' G V^^{vl). Consider Quivj')- Note w 
has no outgoing edges in ^12 (w) and w' has no outgoing edges in ^12 (w'). Let the reception 
of node w and w' in ^i2(w) be ^w,si • a + ^w,s2 " b and /3„',si ■ a + Pw',s2 ■ b respectively, where 
/^w,s2) /^w',s2 0- Just make all nodes choose the same coefficients in ^12 (w') as in ^12 (w) except 
for node w' which chooses ttw'biafw') = «w • Then, the receptions of all nodes will be 

'^w',S2 

identical to those in Quivj). This achieves (1,1) in Quivj') and hence, there cannot be any 
omniscient node in this network either by the Omniscient node outer bound. 

F. Proof of Lemma 5.1 

Without loss of generality let i = 1. We shall prove this by induction on the layer index where 
u lies. Say u e Ck. The node u receives (iu,si ■ a + /9u,s2 • b. 

For k = 1, /3u,si = asi/^si,si = ttsi- Since all predecessors of u are doing RLC, so does Si and 
hence cis-^ is chosen uniformly and randomly over ¥2r. Therefore, Pr{/3u^si = 0} = Prjasi — 
0} ^ as r — >■ 00. 

Suppose for all nodes in Z > 1, that are reachable from Si the coefficient of user I's 
symbol a is non-zero with high probability. Consider an Si-reachable node in Ci+i. We have 

since for nodes that cannot be reached by Si the coefficient of a is always 0. Conditioned on a 
realization of {/3v,si : v e V^^{\i)} where they are not all zero, ^u,si is uniformly distributed over 
F2r since {ctvl v e 7^^i(u)} are chosen independently of one another and {/5v,si ■ ^ ^ "^^^(u)}, 
and uniformly over F2r. Consequently, 

Pr{/3,,si = 0|{/3v,si: v e P^^u)}} ^ 

as r — > 00, if {/3v,si ■ V ^ ■P^^(u)} are not all zeros. By the induction assumption, the probability 
that they are all zeros also goes to zero as r ^ 00, and so we have Pr {/9u,si = 0} ^ as r ^ 00. 
This completes the proof by induction. 
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G. Proof of Lemma 5.2 

1) Proof of Part (a): Consider a super-sink d' with full access to the reception of all nodes in 
U. Since C(si,S2;W) = 2, we have C(si,S2; d') = 2. Moreover, we can easily argue that both Si 
and S2 can reach d' by contradiction, and hence C(Si; d') = 1, for i = 1, 2. Consider a multiple 
access flow problem with two sources Si, S2 and a single destination d'. The capacity region is the 
square region {{Ri,R2) : Ri,R2 >0,Ri< C(si;d'),i?2 < C(s2; d'), i?i + i?2 < C(si,S2;d')} 
and can be achieved via scalar random linear coding if the extension field size 2'' is sufficiently 
large [17]. Hence (1, 1) can be achieved, and d' can decode both user's symbols and so can U. 

2) Proof of Part (b): Fix the transmission from P(v) \ U. We write the reception of v as 



From part (a) we know that U can collectively solve a and b with high probability, and hence 
it can construct any linear combination of a and b. Therefore, they can arrange their transmission 
by choosing the scaling coefficients ct's carefully so that combined with the given part in v, the 
aggregate reception at v is the desired linear combination. 

3) Proof of Part (c): From part (a) we know the the subspace spanned by the received linear 
combinations of U has dimension 2 with high probability. The received linear combination of u 
spans an one-dimensional space with high probability. Note that hi \ {u} ^ $. 

Consider the subspace spanned by the received linear combination(s) of W\{u}. This subspace 
is either has dimension 2 or has dimension 1 but not aligned with the reception of u. In the 
first case, after the nodes in U \ {u} chose the scaling coefficients randomly, uniformly, and 
independently over F2r, the resulting effective linear combination at v contributed by this part 
is uniformly distributed over the whole two-dimensional space. Hence it is not aUgned with the 
reception of u with high probability, u can then choose its scaling coefficient properly so that 
any desired linear combination except those aligned with the reception of u can be formed at 
V. In the second case, it can be guaranteed that the resulting effective linear combination at v 
contributed by U \ {u} is not aUgned with the reception of u. Hence we arrive at the same 
conclusion as above. 
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4) Proof of Part (d): This is a simple corollary of part (c). Since u is SiS2-reachable, with 
all its predecessors doing RLC it will receive a linear combination of a and b with non-zero 

coefficients for both symbols with high probability. Hence linear combinations consisting of 
purely a or 6 with high probability at v can be formed at v due to the conclusion in part (c). 

H. Proof of Lemma 5.3 

C(si, S2; W) = 2. Note that all nodes can be reached by at least one of the source nodes. Fix 
node u eU. 

For sufficiently large block length A^, if all nodes perform RLC with one symbol from each 
source, then by Lemma 5.1 and Lemma 5.2(a), we have the following with high probability: 

• the subspace spanned by the received linear combination at u has dimension 1, and 

• the subspace spanned by the received linear combinations at U has dimension 2. 

Fix any choice of the coefficients so that the above hold. Pick any other node w eU such that 
the subspace spanned by the received linear combinations at u and w has dimension 2. Then, we 
must have C(si,S2; u, w) = 2, or else u, w could not have received linearly independent linear 
combinations. 

(Note: Lemma 5.3 is a purely graph-theoretic lemma. It is easier to prove it however using 
the random coding arguments in Lemma 5.1 and Lemma 5.2(a).) 

/. Proof of Lemma 5.4 

For all four cases, the direction "<^" is quite obvious. Also note that when kl = k2 = k* and 
there is no omniscient node in, the two clone-sets, /C(vJ) and /C(v2), partition the whole layer 
Ck*- Therefore, it is sufficient to look at and V2 only. 

For the other direction "=^", we shall prove the first and the third case, in which the superscript 
of the conditions is "(12)". To satisfy T^^^^ and T^^^^ (equivalently P2^^^ and P^^"^^), we require 
C (si, S2; 7'^^(v^)) = 1 as well as /C^^^ (u2i) forms an (si;di) -vertex-cut in Q12. In generating 
Q12, since there is only one node V2 (up to clones) in the same layer as v*, the reorganization step 
will not involve any change in edges, as M = 1. There are two possible cases where JCg^^ (u2i) 
forms an (si; di) -vertex-cut in Qu'. U21 7^ V2, or U21 = Vg. 

In the first case where U21 7^ V2, we have Cg^,^ (si, S2; 7^g;i2(v2)) = 1- Hence all nodes in V^'^{yl) 
are parents of V2, and C (si, S2; P(v2) \ 'P^^(vi)) = 1. Due to the fact that vj[ is not omniscient, 
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S2 must be able to reach 7'(v;) \ V^^{yl). On the other hand, nodes in P(v*) \ V^^{yl) are all 
Si -only-reachable and hence cannot belong to 'P(v2)\'P^^(v^). Similarly nodes in V(y2)\'P^^(yi) 
cannot be in V{y*i)\V^'^ {y\). Therefore, we conclude that Ui is Si -only -reachable, C (si, S2; W) = 
C (si, 52:^2) = 1. Then condition 3 and 4 in T*^^^-* (P^^^'') imply the rest of the conditions in the 
right-hand-side of the case T^^^^ (P^^^^). It is quite easy to see that in this case P^^^^ n T^^^^ = 0. 

In the second case where U21 = Vg, V{y\) \ V^'^{y\) should be equal to the set of Si-reachable 
parents of V2 in Q12. If T^^^^ is satisfied, then v* and will share the same Si-reachable parents, 
contradicting the assumption that there is no omniscient node. If Pg^^^ is satisfied, then it must be 
the case that V2 has no parents in V^'^{y\). Therefore, ^^^(v^) = Wi, all nodes in W are Si-only- 

('12) 

reachable, and all nodes in Ui are S2-only -reachable. Then condition P4 ' implies that /C^^ (W12) 
forms an ($2; d2)-vertex-cut. Then it is easy to verify that T^^^^ is satisfied. So considering 
p(i2) \^ Y*^^^), this pattern will not be included. Proof complete. 

J. Proof of Claim 5.1 

It is quite obvious that (1,1) is achievable when W = 0. The assumption that there is no 
omniscient node combined with Ul^ = or Ul^ = 0, implies the following three cases: 

1) P=i(v*) C P=i(v*) and ^'^(v*) \ P=2(v*) ^ 0: Pick Ui e ^''^(v*) and then find a node 
wi G V{y\) such that C(si, S2; ui, wi) = 2. Such a node exists by Lemma 5.3. Pick nodes 
U2 e V^^{y*2) \ P'2(v*) and W2 G ^'^(v;) \ V^^{y\). Note that U2, W2 may be the same node. 

(i) Suppose there exist U2 and W2 described as above such that C(si,S2; U2, W2) = 2: See 
Fig. 6(a) for an illustration. We first arrange the transmission of Ui and Wi so that only 
user I's symbol appears at v*. This can be done due to Lemma 5.2(a). Next we arrange 
the transmission of U2 and W2 so that the effect of user I's symbol in the transmission of 
ui (and possibly W2) at can be neutralized, and user 2's symbol can appear cleanly. This 
can be done due to Lemma 5.2(b). 

(ii) Suppose C(si, S2; U2, W2) = 1 for all U2 and W2 described as above: Then, we must have 
V^^{y*2) \ V^^{y\) = V^^{y*2) \ V^^{yl), for if not, we can always find nodes U2 e ^''^(v^) \ 
V^^{y\) and wa e V^^{y*2) \ V^^{yX) such that C(si,S2; U2, ws) = 2. Thus, there must be a 
node W2 e P(vi) fl 'P(v2) such that C(si,S2; U2, W2) = 2, by the definition of Vg. Note that 
W2 may be the same node as ui, wi, or a clone of either one. Also note that now U2 must 
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(a) Illustration of Case l)(i). ui and W2 are si- (b) lUusttation of Case l)(ii)(l). ui is si- 
reachable and U2 is S2-reachabIe. reachable, U2 is S1S2 -reachable, and wi is si-only- 

reachable. 
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(c) Illustration of Case l)(ii)(2). ui is Si- (d) Illustration of Case Al n B2. ui is Si- 
reachable and U2 is siS2-reachable. reachable and U2 is S2-reachable. 



Fig. 6. Critical Nodes in the Same Layer 



be SiS2-reachable. See Fig. 6(b)(c) for an illustration. We further distinguish into two cases 
based on whether wi is a parent of V2 or not: 

(1) If wi is not a parent of Vg, then it is S2 -only-reachable since V^'^ (v^) C V^^ (vg). We let Ui 
and W2 do RLC. Since U2 is SiS2-reachable, by Lemma 5.2(d), it can arrange its transmission 
so that V2 can decode S2's symbol. We can then use wi to neutralize user 2's symbol in v]"s 
reception if necessary. Since ui is Si-reachable, can obtain user I's symbol cleanly after 
neutralization. 
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(2) If Wi is a parent of then we first arrange the transmission of {ui,Wi,W2} so that 
V* can decode user I's symbol. This can be done due to Lemma 5.2(a). Next, since their 
aggregate at V2 has only user I's symbol and U2 is SiS2-reachable, we can arrange the 
transmission of U2 so that user I's symbol is neutralized and only user 2's symbol is left. 

2) V^''{vl) C V^^iyl) and ^'^(v*) \ V^^iyl) 7^ 0: Similar to the previous case. 

3) 7''i(v*) C V^^{\il) and V^^{\il) C V^^{mI): Pick a node Ui e V^^{\il) \ V^^{mI) and a node 
U2 e V^^{y*2) \ V^^iyl). By the definition of and v^, we shall be able to find wi e V{\il) and 
W2 G '^(vg) such that C(si,S2; ui,wi) = C(si,S2; U2,W2) = 2. Note that wi,W2 may be the same 
node but Ui, U2 are different nodes, although they may be clones. We shall show that (1, 1) is 
achievable. First let {wi, W2} do RLC. Then we can arrange the transmission of Ui and U2 such 
that V* and can obtain their desired symbols due to Lemma 5.2(c). 

K. Proof of Claim 5.2 
Note that 

^{Ay B)^^{Al^ A2) A ^ (SI A B2) = {^Al V ^A2) A {^Bl V ^B2) 

= {^Al A -^Bl) V {^Al A -^B2) V {^A2 A -^Bl) V {^A2 A -^B2) . 

We distinguish into 4 cases. 

1) ^AlA^Bl: 

In this case, there is a node in Vl^ that is SiS2-reachable and there is another node in Vl^ 
that is Si-only-reachable. Hence C (si, S2; Vl^) = 2. We can first arrange the transmission of 
P(v2) so that V2 can decode b. Since C (si, S2; Vl^) — 2, we can arrange their transmission 
to form any linear combination of a and b; in particular, the one that combined with the 
transmission from W forms a at v^. Hence (1,1) is achievable. 

2) ^A1A^B2: 

In this case there is a node ui G Vl^ that is S1S2 -reachable and there is a node U2 G 7^2^ that 
is SiS2-reachable. Locate nodes wi G P(v^) and W2 G V{v2) such that C (si,S2; ui, wi) = 
C (si,S2; U2, W2) = 2. Note that Wi, W2 may be the same node but ui, U2 will be different 
nodes although they may be clones. Then, let wi,W2 perform RLC while Ui,U2 arrange 
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their transmissions so that v*,V2 can decode their desired symbols. This can be done with 
high probability due to Lemma 5.2(d). See Fig. 6(d) for an illustration. 

3) -^A2A^B1: 

In this case there is a node in V^^ that is Si -only-reachable and there is a node in that 
is S2-only-reachable. Obviously (1,1) is achievable. 

4) ^A2A^B2: 

In this case, there is a node in 7^1^ that is S2 -only-reachable and there is another node in 
7^2^ that is SiS2-reachable. Similar to the first case, (1, 1) is achievable. 
Proof complete. 

L. Proof of Lemma 5.5 

We shall distinguish the condition V^^{ii2) V^^{\/1) into two cases, (1) V^^ {ii2)\V^^ 7^ 0, 
and (2) Viu2) QVivl). 

1) :P''(u2) \ P''(vi) ^ 0.- In this case, if P'^^^g) n V'^{vl) = 0, then the special linear 
coding operation in V^^{u2) will not affect the coefficient of user 2's symbol b in the reception 
of u. Therefore the goal in the claim of this lemma can be met from C(si, S2; P(v^)) = 2 and 
Lemma 5.2(b). Below we consider the case where P^^(u2) n V^^{yl) 7^ 0. 

If V^^{\/l)\'P^^{u2) ^ 0, then we shall let the nodes in P'2(u2) nT^'^^y*) rlc Hence the 
parents of u 2 are all doing RLC. Since S2 can reach U2, the coefficient of h in the reception of U2 
is non-zero with high probabiUty. Now we turn to v^. As C(si, S2; 7'(v^)) —2 and all nodes other 
than V^'^iyX) \ ^^^(^2) are doing RLC, by Lemma 5.2(c) they can arrange their transmission so 
that m\ receives a linear combination consisting of a solely. 

2) V'^'^{\i2) C V^'^iyX)'- 111 this case we let the nodes in P^^j^^i^) do RLC. Hence the coefficient 
of h in the reception of U2 is non-zero with high probability since all its predecessor are doing 
RLC. Then as C(si,S2;P(v*)) = 2 and all nodes other than V^'^iyX) \ ^''(u2) are doing RLC, 
by Lemma 5.2(c) they can arrange their transmission so that receives a linear combination 
consisting of a solely. 

M. Proof of Lemma 5.6 

The special coding operation performed by nodes in ^^^(v^) is as follows: Nodes choose their 
coefficients independently and uniformly over the set of coefficients satisfying ^^^n Qiu/3u,s2 — 0- 

January 26, 2013 DRAFT 



45 



Under this special coding, it is easy to show the first part of the assertion, namely, that each 
node receives a non-trivial linear combination. Because the reception of ^^^(v^) has full rank, 
the linear constraint leaves the sum X^ue^/ '^u/^u.si non-zero with high probability. This allows us 
to argue that any Si-reachable node receives a non-zero coefficient for the symbol a transmitted 
by source Si inspite of the special coding. 

Find node u eU such that u ^ JO'^{\/l). and u is S2 -reachable. Such a node exists because 
is not omniscient. Then, find node w e U such that C(si,S2; u,w) = 2. If all nodes in V^^{\/1) 
performed random linear coding, then u, w jointly can decode both symbols a and b with high 
probability. 

Let Vi := V{u)\V{\n),Vi2 := P(u) nP(w),P2 := V{\n)\V{u). 
. As P(u) ^ 0, we have Vi U V12 ^ 0. 
. As V{w) ^ 0, we have 7^12 U 7^2 7^ 0- 

. As V{\\) ^ V{w) (since C(si, S2; u, w) = 2), we have ViUV2y^ 0. 
Note that the conditions on the sets Pi,Pi2,7'2 are symmetric. 
Reception of node u: 



(Ex 



ePiUPi2 



a- 



c/5x,sj • a + (Ex, 



;e7'iUPi2 



a 



A,s,) ■ b 



Reception of node w: 



(Ex 



a. 



x,si) • a + (Exe7'i2UP2 '^x/?x,s2) ■ b 



Exe7'iU7'i2 ^x-Px-M Exe'PiU'Pi2 '^x/5x,S2 
Exe'Pi2U'P2 "^x/^x-si ExePi2UP2 "^x/^x-sa 

symbols a and b 



LetD : = 
decode both 

For two nodes x, y, denote the determinant 
determinant D to be expressed as: 



D is non-zero if and only if u, w can jointly 



''X,S2 

^y,s2 



by /3(x, y). Some algebra allows the 



D=^ ^ axay^(x,y)+ «xQ;y^ (x, y) 

xeVi yeVi2 xePi2 yeP2 

+ ^ ^ axQ;y/3(x,y). (7) 

xeP2 yeVi 

Note that D is also symmetric in the sets Vi,Vi2,'P2- Let the special coding set V^^{vl) 
be denoted by V. We are given that C(si,S2;P) = 2. The constraint placed on the coding 
coefficients of nodes in V is Exep '^x/3x,s2 — 0- 
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. Suppose \ (7^1 U 7^12 U V2) ^ 0. 
Because we have with high probabihty, /3x,s2 7^ OVx e P, we can view the special coding as 
all nodes in P1UP12UP2 performing random linear coding while nodes in P\(PiUPi2UP2) 
performing restricted coding. In this case, parent nodes of u and w perform RLC and so, 
the claim is obviously true. 

• Suppose V QVil) V12 U V2 and suppose there are two non-empty sets among V r\Vi,V r\ 

Without loss of generality, assume V r\Vi ^ 0. Fix xq G V r\Vi. Find xi e V such that 

C (si, S2; xo, xi) = 2. If xi G V12 or xi G V2, then we have xq e V (1 Vi, and xi G P fl V12 
or xi G P n P2 such that C (si, S2; xq, xi) = 2. 

If xi G Pi, then pick any node X2 in the non-empty set V fl {V12 U P2)- By submodularity, 
we have C (si,S2;xo,xi,X2) + C (si,S2;x2) < C (si, S2;xo,X2) + C (si, S2;xi,X2) . Since the 
two terms on the left are 2 and 1 respectively, at least one term on the right must be greater 
than 1 and thus, 2. 

Thus, we can always find nodes xq G Vr\E, xi G PnF, where {E, F) = (Pi, P12), (P12, P2) 
or {V2,Vi). such that C (si,S2;xo,xi) = 2. 

Suppose, without loss of generality, we have xi G PfiPi, X2 G PnPi2 so that C (si, S2; xi, X2) = 
2. We set a,, = p-],^ (j2.er\{.^} «x/3x,s2) ■ 

Then, evaluating Equation (7) with this substitution for a^^ gives us a polynomial in (ctx : 
X G Pi U P12 U P2 \ {xi}) with coefficients being rational functions in (/5x,si , /3x,s2 ■ ^ ^ 
Pi UP12 UP2 \ {xi}) which are themselves polynomials in the coding coefficients from the 
past stages. This polynomial has a coefficient for only in the sum 



xe-p ye-Pi2U7'2 

^ Yl Yl % ["x/3(x,y) + Q;x/3x"j;s2^x,s2^(xi,y)] 
^ J2 "x%|^/3(xi,x) 

xe7'\{xi}ye7'i2U7'2 ^"1-^2 

where the last equality follows from the identity /3x,s2/5(xi, y) +/3xi,s2/5(x, y) + /3y,s2/5(xi,x) = 
0. 
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Putting X = y = X2 gives the coefficient of a^^ to be ^^/3(xi,X2) which is not identically 
zero since each of (5^2, S2-, /Sxi.sa? /3(xi,X2) are not identically zero, the first two because xi,X2 
lie in V and so are S2-reachable and the third because C (si, S2;xi,X2) = 2. 
Thus, D is not identically zero and hence, evaluates to a non-zero value with high probability. 
• Finally, suppose P C Pi or P C P12 or P C P2- 

- First, suppose V QVi. Fix xi e P. There exists X2 e P such that C (si, S2; xi, X2) = 2. 
Force = (ExeP\{xi} "x/^x.s^) ■ 

D 

= ^ ^ axay/3(x,y)+ ^ ^axay/3(x,y) 

xg-Pi yG7'i2U'P2 xe7'i2 ye'P2 

= X1 X] axtty/3(x,y) 

xeP ye'F'i2U7'2 

+ X "xay/5(x,y) + ^ ^ axay/5(x,y) 

xeVi\V yePi2UP2 xePia yeP2 

= X X axQ;y|^/3(xi,x) 
xeP\{xi}yePi2UP2 ^''i'^^ 

+ X X «xQiy/3(x,y) + ^ ^ axQiy/3(x,y) 

xeVi\V yePi2UP2 xePi2 yeP2 

As u ^ /C^2(vj[), we have that some node yo G P12 is S2-reachable. Then, /3yo,s2 is not 
identically zero and the coefficient of Q;x2Q;yo identically zero. 

- Suppose P C P12. Then, fix xi e P. There exists X2 e P such that C (si, S2; xi, X2) = 2. 
Force a^,, = l3^\,^ i 

SxeP\{xi} '^x/3x,S2 ) • 

^= X X «xQ;y-^^^(xi,x) + ay,ayp(x,y) 

+ X X «x%^(x,y). 
xeVi yer2 

Again, since u ^ }C^'^{\/1), we have that some node yo e Pi is S2-reachable. Then, /5yo,s2 
is not identically zero and the coefficient of a^^ay^ is not identically zero. 

- Now, suppose P C P2. Then, fix xi e P. There exists X2 G P such that C (si, S2; xi, X2) = 
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2. Force a,, - /3,^],^ {E.ev\{.,} "x/3x,s. 



D= ^ Q;xQ;y^^/3(xi,x) + ^ ^ Q;xQ;y^(x,y) 

xe7'\{xi} y67'iU-Pi2 ^""^'^^ xer2\P yeViUVi2 

+ XI XI «xQ;y/3(x,y). 

Again, as u is S2-reachable, we have that some node yo e T'l U V12 is S2-reachable. 
Then, pyQ,s2 is not identically zero and the coefficient of axjOiyo identically zero. 



A^. Proof of Lemma 5. 7 



for 



For A C define f{A) as the rank of the \A\ x 2 matrix with rows given by 
u e ^, and define g{A) — C {A;V) . Then, f{-),g{-) are rank functions of two matroids on the 
same ground set U. The given conditions tell us that both these matroids have rank at least two 
and every singleton subset has rank 1 in both matroids. We will first show that there exist a 
two-element subset of U that has rank 2 in both matroids. 

Find two elements x, y e W, such that /({x, y}) = 2. If g{{x,y}) = 2, we have found the 
desired two-element subset. Else, we must have g{{x,y}) = 1. Then, there exists an element 
z eU such that g({x,z}) = 2. If /({x, z}) = 2, we have the required 2-element subset. Else if 
we have /({x, z}) = 1, then by submodularity, we must have 

/(«) + /({x,y,z})</({x,z}) + /({y,z}) 

^({y}) + ^({x, y, z}) < ^({x, y}) + ^({y, z}) 

These give /({y, z}),g{{y, z}) > 2, and thus, {y, z} is the required subset of U that has rank 
2 in both matroids. 

Ax A 



Thus, we have two nodes x, y e W such that 

Ay /iy 

Again, for A C V, the function defined by h{A) = C 



and C (x, y; V) = 2. 

X, y; A) is the rank function of a matroid 
over ground set V that has rank two. Thus, there exist u, w G V such that C (x, y; u, w) = 2. 

Thus, when all nodes perform RLC except nodes mU\ {x, y} remain silent, we have that u, v 
can jointly recover both symbols a and b. 

Now, if all nodes perform RLC, the a and b coefficients of the receptions of nodes u, v would 
be polynomials in the random coding coefficients with a determinant that is a polynomial that 
is not identically zero. QED. 
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O. Proof of Lemma 5.8 

If V2 has a parent from user I's cloud Ci, then in either Q12 or since this node in the cloud 
becomes Si -only -reachable while V2 can be reached by S2, V2 remains to be the critical node for 
user 2, ie., Pmc0^2(d2) = Pmcgi^^{d2) — Since the Si-clones of V2 form an (si; di) -vertex-cut 
in Q12 but not in Q, the only possibility is that some parents of V2 are not in the cloud Ci and 
are dropped in ^12. These nodes are descendants of 7'^^(v*), which becomes Si -only-reachable 
in Q[2- Therefore in Q[2, ^2 has some Si-reachable parents that is not in the cloud Ci, and hence 
the Si-clones of V2 do not form an (si; di)-vertex-cut in Q[2- 

In the rest of the proof we deal with the case where has no parents from user I's cloud Ci. 
Hence "si-clones of form an (si; di) -vertex-cut in ^12" impUes that Cg^^{si, S2; Vg-^2{^2)) — 1- 
We shall show that, for all possible ^^2' either 05^^(51, S2; 7^0(2(^2)) — 2, which implies that 
Pmcg'^^{d2) — V2 and Si-clones of V2 do not form an (si; di) -vertex-cut in ^^2' or directly prove 
the statement. 

Below a few notations are given before we proceed. := {u G £fc* : u can reach d2}. ^\g[^ 
and W|gj2 denote the nodes in the same layer as that can reach d2 in Q[2 and Q12 respectively. 
Recall that TZ is the set of nodes in V^'^{^\) that can reach one of the two destinations in Qi2- 
Define the following subsets of U: (use short-hand notations V for 7'^^(v2) and S -.— VXTZ) 

Up := {u : V{u) DV}, Uq := {u : V{u) n P = 0} 
Un := {u : V{u) n P ^ 0, V{u) nV QU} 
Us:={u:SC r{u)r\V C V} 

Note that these four sets form a partition of U, and }C^^{\/1) (lU CU-p. 

Let us consider the following two cases: 1) 7?. 7^ 0, and 2) TZ — Note that when generating 
induced graphs G12 and G[2-> some nodes may be dropped as they are no longer reachable from 
the sources. Consequently Ulg-^^ and Wjgj^ may be strictly contained in U. In the following 
discussion, we shall further distinguish into these cases. 

1) 7^y^0: 

We shall show that in this case, Cg^^(si, S2; Pgj2(^2)) — 2- 
(A) Iy{\g[,^ = U: Since no nodes are dropped in U when generating Q[2, no nodes will be dropped 
in the later layers and C [U] V{m*2)) remains the same in Q and Q[2- As C {U] V{m*2)) > 2 and 
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all non-vertical cuts have cut-values at least 2, we only need to show that Cgj^ (si, S2; U) — 2. 
=U: 

In this case, since W|g,, = U, we have Cg,^ (Wlg^^; ^^12(^2)) = C (W; Viyl)) > 2. Therefore, 
C0i2(si,S2;Pei2(v;)) = 1 implies that Cg^^{si,S2-M\Gi2) = 1- 

Suppose that C (si,S2;W7e) = 2. Since nodes in U-n will not be affected in generating Q12, 
Cgjj — 2. Hence Cg^^ {si,S2]U\g^^) — 2, contradicting the above fact. Besides, 

Un 7^ 0. Therefore, C (si, s^-Mn) = 1- 

Find a node u e W such that C (si, S2; Uji U {u}) = 2. Below we show that this node u e 
by contradiction. Suppose u G Wq. As the nodes in Uq will not be affected in generating 
Q12, we have Cg^^ (si, S2; Un U {u}) = C (si, S2; U-ji U {u}) = 2, contradicting the above fact 
that Cg^^{si,S2-iU\g^^) — 1. Next, suppose u e Wp. Let us first consider the min-cut value 
from {si, S2} to the collection of parents of Un U {u}, denoted by V {Un U {u}). It is 2 in 
Q. In Q12, nodes in S are dropped, but nodes in TZ and nodes in V {Un U {u}) \ are not. 
Therefore the min-cut value is again 2 since nodes in TZ receive the same linear combination 
as those in V under any RLC scheme. Second, it is clear that in Q12, Un U {u} are not 
clones as u has no parents in TZ. Hence, Cg^^ (si, S2]Un U {u}) = 2, again contradicting the 
above fact that Cg;^2(si, S2; Wlg^j) — 1- 

Hence, u eUs for all such u. We use the same argument as above to show that the min-cut 
value from {si, S2} to V {Un U {u}) is again 2 in Q12. Then C0j2(si, S2; Wlg^j) — 1 implies 
that Un U {u} become clones in Q12. Next, we turn to look at Q[2. First, obviously Un U {u} 
are not clones in Q[2, as u has some parents in S which are not dropped in Q[2- Second, 
Cgj^ (si, S2; Pgj^l^)) = 2 as 7^ becomes Si-only-reachable in while S2 can reach some 
other node in 'Pg[^{U). Combining the above two, we have shown that Cg/^ (si, S2;U) — 2. 
(ii) U\g,,y^U: 

Some nodes in U are dropped in generating Q12 and hence U fi /C^^ (v*) 7^ 0. The nodes in 
this intersection will be come Si -only-reachable in Q[2. Since some nodes in U\g'^^ — U can 
be reached by S2 in Q[2^ we conclude that Cgj^ (si,S2;W) = 2. 
(B) U\g'^^ 7^ U: Some nodes in U are dropped in generating Q'12, and the collection of these 
nodes is U \U\g'^^. In the same layer as V^^{wi2), consider the collection of predecessors 
of nodes in U\U\g' . It must be equal to V^'^{\Ni2), otherwise nodes in U\U\g' would 
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not be dropped in generating G[2- Hence, U \l/(\g'^^ cannot be reached by /C(wi2), and 
has no parents in V. Therefore U \ U\gi^^ C Uq. Nodes in \ hence will not be 
dropped in Q12 and Cg^^ {si.s^M-ji UUq) = 2, as nodes in U \ V(\g'_^,^ can only be reached 
by P^^(wi2) while nodes in U-ji can be reached by W12 and its Si -only-reachable parents. 
Hence, the only possibility such that C0^2(si, S2; 7^012(^2)) = 1 is that U\g^2 7^ U and 

Note that Cg,^ (Uy^^lVg^Jy*,)) = C (W^j^; 7^^)) andCg,^ {K\g,.;Vg,M)) ^C{U\g,,;V{ 
Also note that U \ U\g^2 will not be dropped in 0^2, and U \ l^\g[.^ will not be dropped 
in Q12. Hence U is partitioned by U \U\g'^^, U \ U\g^^, and U\g^^ nl4\g'^^. Furthermore, 

Un^u\g,,nuy^^. 

We first show that C (Z^lg/^; P(v2)) > 2. Define a function of the subsets of U by 

f{A) :^C{A■,V{^f*2)): ACU. 
Since / is submodular, we have 

3 < / {uig,., nuyj +f{u)<f {uw.,) + / (wbjj 

1 + / (^bl J ^ / {U\gQ > 2. 

(a) is due to f (U) > 2 and / {U\g,^ n > 1 since U-jz C U\g,^ nU\g'^^. (b) is due to 

fmgj = i. 

Next we show that Cgj^ (si, S2; = 2. This is easy to see, since V(\V(\g-^^ will become 
Si -only-reachable in some other nodes in Vl\g[^ can be reached by S2. 

Combining the above arguments, we conclude that Cgj^ (si, S2; ^0(^(^2)) — 2. 

2) 7^ = 0: 

In this case, U = U-p D Uq. For notational convenience, we denote V{U) \V hy Q. Since 
in Q12 the nodes in V no longer connects to U-p, V{U.\g-^^) — Q. Note that if U-p ^ 0, then 
Cgi^^ {si,S2]V{U.\g'^yj — 2 since V C V{U), and nodes in V become Si -only-reachable in ^[2 
while some other nodes in V{U\g'^^) can be reached by S2. 

Cg,, (si,S2;Pei2(v*)) = 1 implies that: (A) Cg,, (si,S2; Q) = 1, (B) Cg,, {Q;U\g,,) = 1, or 
(C) Cg^2 (^1512)^512(^2)) = 1- Below we discuss the three cases respectively. 
(A) Cg,,{suS2;Q) = 1: Suppose Up = 0, then P(W) = Q, and Cg,^ (si, S2; Q) = 1 im- 
plies C(si,S2;Q) = 1 contradicting the definition of Vg. Hence Up ^ 0, implying that 
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If Wlej^ are not clones in and Cgj^ (^bj^; ^612(^2)) > 2, then Cgj^ (si, S2; Pq^(v*)) = 
2. 

If U\g[^ become clones in ^[2^ then u'21 := Pmcgj^(di) must belong to this new clone 
set. Its parent set is P U Q\g[^, as some nodes in Q may be dropped in ^^2- ^ becomes 
Si -only-reachable in ^^2' while has some Si -only-reachable parents not in V. Hence, 
^0^2^! ^ (^21) ~ ^' ('^21) does not form a (si; di) -vertex-cut in ^[2- 

If Cgj^ (^bja' ^512(^2)) = 1' then Wjgj^ that is, some nodes in Uq are dropped in 
^[2- But no nodes in Up will be dropped. A node in Up is Si-reachable in Q[2, and is 
an predecessor of U21. This node cannot lie in )C{\/1), otherwise Q contains some Si-only- 
reachable nodes implying that all nodes in Q are Si-only-reachable, contradicting the fact 
that in ^[2 some nodes in Q\g[^ can be reached by S2. Hence this node is not an predecessor 
of any node in the cloud Ci. In ^^2' ^'21 ^ Si-reachable parent whose predecessors include 
this node in U-p, and this parent is not in the cloud Ci. Therefore, JCg, {U21) does not form 
a (si; di)-vertex-cut in Q[2. 

(B) Cgjj (2j^bi2) = 1- III this case, W|g^2 become clones in Q12. Suppose Up = 0. Then 
^bi2 = ^ clones in Q, contradicting the definition of V2. Hence Up 7^ 0, 
implying that Cg>^^ (si,S2;'P{U\g'^J) — 2. Moreover, we see that Uq are clones in Q. 
Suppose 7^ U. We know that U\U\g'^^ C Uq. Since Uq are clones in Q, we conclude 
that U \ U\gi^^ — Uq, implying that all nodes in Uq and Q will be dropped in Q[2. This 
contradicts the fact that some nodes in U\gi^,^ can be reached by S2. Therefore, = U. 
In (y^2' nodes in Up have parents in V. Therefore obviously U\gi_^^ = U are not clones in 
Q[2- Combining the above discussions, we conclude that Cg/^ (si, S2; 'Pg;2(^2)) = 2. 

(C) Cgjj 1 012; ^612(^2)) — 1- In this case, we must have Ug^^ ^- If ^bjz ~ ^' ^® 

same argument in Case l)(A)(ii) to show that Cgj^ {^i:^2',Vg'^^{\/2)) — 2. If If U\g'^^ ^ U, 
we use the same argument in Case l)(B)(ii) to show that Cg/^ (si,S2;'P0(2(v2)) = 2. 
Proof of the claim is now complete. 

Appendix B 

(1/2, 1)-ACHIEVABILITY IN CASE A WHEN kl = = k* 

We first state a useful lemma. 
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Lemma B.l: Let p{ai, 0:2, . . . , q{ai, a2, ■ ■ ■ , e F2[q;i, a2, ■ ■ ■ , «„] such that p, q are 
not identically equal to zero or to each other. If a 1, 0:2, ctn are chosen independently and 
uniformly over F2fe, then 

• q{ai,a2T . . ,an) 7^ with probability at least 1 — O(^), so the rational function 2 is 
well-defined with high probability, 

. and P(2 = 7) = O(^) for all 7 e F2.. 

Proof: We use a standard result from finite fields which states that if a multivariate poly- 
nomial g in n variables over finite field F with degree in each variable at most d, is evaluated 
at an argument chosen uniformly over the set of possible arguments, then it yields zero with 
probability at most provided of course that the polynomial is not identically zero. 

This proves the first item in the lemma with g — q and the second item in the lemma for the 
case 7 = using g — p. 

For 7 = 1, we use the fact that p — q is not identically zero to get P( 2 = 1) = 0{^). 

For any other 7 G F2fc , we notice that p — 'jq cannot possibly be identically zero unless both 
p and q are identically zero. This is because p, q have coefficients from F2 while 7 7^ 0, 1. This 
establishes that p — ^q evaluates to zero with probability atmost O(^). ■ 

We start the proof of (1/2, l)-achievability below. 

Here, we have 

. ui G P'^(vl) \P=i(v*) ^ and U2 G P'^(v^) \ P'^K) 7^ 0, 

• ui is Si -only-reachable and U2 is SiS2-reachable, 

• W2 G V{^2) ^^^^ CI (si, S2; U2, W2) = 2, and W2 is a parent of vj[, and W2 is S2-reachable. 
We will use RLC for the transmission of all nodes in layers through k* — 2. The RLC is 

performed without mixing across the time steps. In the first time step, Si transmits the symbol 
a while S2 transmits the symbol bi. In the second time step, Si transmits symbol a while S2 

transmits the symbol 62. 

Suppose now that W2 is SiS2-reachable. 

Consider the scheme where W2 and U2 both zero-force user I's symbol a. ui and U2 transmit 
in the first time slot, thus causing no interference at v* and W2 transmits in the second time 
slot. 
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We have p2^,s-2 — Pn,s2 — 0, while ^^ui^si 7^ with high probabiUty from Lemma 5.1. Thus 
Ui can decode Si's symbol a with high probability. 

Now, the receptions of U2 in the two time slots are pi'lls-^ -(1 + Pu^2s2 ' t>i and pi^lsi ■a + pi^^ ' ^2 
respectively. Similarly, the receptions of W2 are /3w2^,si • a + /3w2^,s2 ' ^1 and /Sj^lsi ■a + /3i^2^,s2 ■&2- Note 
that the coefficients of these symbols are all non-zero with high probability from Lemma 5.1. 

The zero-forcing yields: 

• Transmission of U2 : /^uak/^uak • h - pu^^Pu^si ■ h 

• Transmission of W2 : /^iaU/^w^si ■ h - /3!^ls2f3wlsi ■ ^2 

To show that V2 can decode, we only need to show that the determinant 
is non-zero, ie that /3uJ^S2l^u2,si/3ij2,s2/-^w2,si 7^ Pu2,s2Pu2,siPw2,s2l^vj2,si or 



rW n{2) _n{2) nil) 
p'U2,S2PU2,Si /^U2,S2PU2,Sl 

^(1) q{2) _q(2) n'^^ 
h'\N2,S2h'v\l2,Sl /^W2,S2/^' 



W2,Sl 



^(1) ^(1) n{2) q{2) 

/^U2,S2PW2,Si , /-^U2,S2PW2, 



7^ 



^(1) ^(1) ^ ^(2) q{2) 
/-'U2,Sl/-'W2,S2 /-'U2,SlPw2,S2 

Note that the coefficients with 1 superscript are independent of the coefficients with 2 su- 
perscript. So, LHS and RHS are two independent and identically distributed random variables 

taking values in F2r. 



/^U2,Sl HU2,S2 



-'W2,Sl h'W2,S2 



7^ with high probability. So, 



By Lemma 5.2, we have that the determinant 

the above random variable is not equal to 1 with high probability. 

Now, we note that the random variable is a ratio of two polynomials with coefficients from 
F2, a ratio that is not identically 1. The equality stating that the ratio equals 7 e F2t^,7 7^ 0, 1 
is an equaUty stating that a polynomial not identically zero evaluates to 0. If all coefficients are 
chosen indpendently and uniformly at random, this polynomial evaluates to with probability 
O ^jf^^ ■ Thus, the random variable does not concentrate on any given value 7 e F2r and so, 
two independent and identically distributed copies of the random variable are unequal with high 
probability. 

Suppose that W2 is S2 -only -reachable. Then, ui, U2 transmit in the first time slot with U2 zero- 
forcing user I's symbol a. In the second time slot, W2 which can recover both bi and b2 with 
high probability, provides a Unearly independent signal to U2's transmission. 
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Appendix C 
Formal Proofs of Outer Bounds 

A. Proof of the Omniscient Bound 

Since /C(v) is a (si,S2;di) -vertex-cut, the received signal at di, Iji is a function of Y^. On 
the other hand, since /C^^(v) is a ($2; d2) -vertex-cut, we have that Yj^ is a function of and 
YJ^. Hence we have the Markov chains 

^ ^ y^"! (8) 
^s^^(n"^,^sT)^>^dr (9) 

By Fano's inequality and the data processing inequality, we have for any scheme of block length 

N, 

N + R2- ejv) 

< I {X:;;Y-) + I {X-;Y-) 

< I (^3^; Yj") + I (XjJ ; r/, ^3^) (from (8) and (9)) 

= H (n^) - H (^^1X3^) + H (n^|X3^) 
= H (y/) < TV, 

where ca? — )■ as ^ 00. Hence Ri + R2 < 1. 



5. Proof of Claim 6.1 

Proof: If i?2) is achievable, from data processing inequality and Fano's inequality, we 

have 

N (2i?i + i?2 - ejv) 

< / (^3^; Z,^, ^3^) + / (^3^; Z^) + I (^3^; Z^,) 
I (^3^; Z^,\X^^) + I (^3^; ) + / (X3^; Z,^, Z,^) 
= (Z,^|X3^) + (Zf ) - (Zf 1X3^) + H {Z,\, Z^,) 
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i H (Zf ) + H (Z.^lXjT) - H {Z^,\X:^) + H {Z^„ Z^,) 

- H (Zf 1X3^) 
<H{Z^)+H{Z,lZ^,)-H{Z^,) 

^H{Z^)+H{Z^,\Z^,)<2N 

where e^r — )■ as A?^ — > 00. (a) is due to condition 2) and 3). (b) is due to the fact that and 
are independent, (c) is due to condition 5) and rearranging terms, (d) is due to condition 
4). (e) is due to condition 1). ■ 

C. Proof of Claim 6.2 

Proof: If R2) is achievable, from data processing inequality and Fano's inequality, we 

have 

<l{X,^^;Z^„Zg,X:^^)+l{xS;Z^,) 

= H {Z^„ Zg\X:^^) + H (Z^[) - H (Z,^|X3^) 

+ -n (^^21, Z22j - -H (^^21, Z22I j 

< H (Z^[) - (^2^1X3^) + H (^2^) + H (Z2^|Z2^) 



(d) 



if(za+i7(Z2^|Z2^)+/(X3^;Z2^2) 



<2Ar + 7(X3^;Za, 



where ei jv — t- as — > 00. (a) is due to condition 2) and 3). (b) is due to the fact that X^^ 
and X^^ are independent, (c) is due to cancellation of terms and condition 4). (d) is due to 
/ (^3^; Z§^) = H {Zg) - H (^2^1X3^). (e) is due to condition 1) and 5). 
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We see that we cannot upper bound 2Ri + i?2 by 2 in this case. On the other hand, 

where e2,N — > as A?^ — > oo. (a) is due to condition (3). (b) is due to the fact that and X^ 
are independent. 
Combining the above two, we have 

N{2Ri + 2R2-eN) 

<2N + I (X,^; Z^,) + H {Z^,\X:;) = 2N + H {Z^,) 

(a) 

where = e^^N + ^2,n ^ as A'^ ^ oo. (a) is due to condition 1). Proof complete. ■ 
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